-- Logs begin at Tue 2022-06-21 09:51:00 UTC, end at Tue 2022-06-21 11:03:54 UTC. -- Jun 21 10:20:38.393751 dv-cinder-836973-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 21 10:20:38.405857 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jun 21 10:20:38 2022] *** Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: nodename: dv-cinder-836973-8-iscsi Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: machine: x86_64 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: clock source: unix Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: pcre jit disabled Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: detected number of CPU cores: 4 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: current working directory: / Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: detected binary path: /usr/bin/uwsgi-core Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: your processes number limit is 47680 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: your memory page size is 4096 bytes Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: detected max file descriptor number: 2048 Jun 21 10:20:38.408730 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: lock engine: pthread robust mutexes Jun 21 10:20:38.409622 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: thunder lock: enabled Jun 21 10:20:38.409622 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 21 10:20:38.409622 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 21 10:20:38.454615 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: Python main interpreter initialized at 0x560c870999c0 Jun 21 10:20:38.454615 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: python threads support enabled Jun 21 10:20:38.454615 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: your server socket listen backlog is limited to 100 connections Jun 21 10:20:38.454615 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: your mercy for graceful operations on workers is 90 seconds Jun 21 10:20:38.454944 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: mapped 403077 bytes (393 KB) for 2 cores Jun 21 10:20:38.455018 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: *** Operational MODE: preforking *** Jun 21 10:20:38.455289 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: *** uWSGI is running in multiple interpreter mode *** Jun 21 10:20:38.455289 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: spawned uWSGI master process (pid: 80163) Jun 21 10:20:38.455491 dv-cinder-836973-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 21 10:20:38.457549 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 1 (pid: 80174, cores: 1) Jun 21 10:20:38.457549 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: spawned uWSGI worker 2 (pid: 80175, cores: 1) Jun 21 10:20:38.457549 dv-cinder-836973-8-iscsi devstack@keystone.service[80163]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 21 10:20:43.846674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:20:43.846674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: from cryptography.utils import int_from_bytes Jun 21 10:20:43.847514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:20:43.847514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: from cryptography.utils import int_from_bytes Jun 21 10:20:43.863484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:20:43.863484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 21 10:20:43.863987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 21 10:20:43.863987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: from cryptography.utils import int_from_bytes Jun 21 10:20:43.895864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:20:43.896204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:20:43.896204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] command line args: [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:20:43.896531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:20:43.896794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ================================================================================ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:20:43.897050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] admin_token = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.897294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_dir = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.897454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.897650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] config_source = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.897812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] debug = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.898013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.898398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.898576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.898849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_config_append = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_dir = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.899963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.900211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.900458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.900695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.900930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.901105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.901279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.901514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.901757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.901987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.902237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.902468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.902694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.902938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.903180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.903437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.903936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.904115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] publish_errors = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.904343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.904568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.904743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.904983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.905215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.905450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] standard_threads = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.905678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.905917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.906113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.906290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_journal = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.906463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_json = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.906635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_stderr = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.906806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] use_syslog = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.907033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.907286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.907524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.907778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.908016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.908260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.908495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.908741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.908974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.909217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.909460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.909709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.909940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.910205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.910350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 21 10:20:43.910475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.910594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 21 10:20:43.910712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.910820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] command line args: [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 21 10:20:43.910928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.911036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 21 10:20:43.911142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.911249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ================================================================================ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 21 10:20:43.911365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.911480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.911636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.912164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_dir = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.912297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.912409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.912529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.912645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] config_source = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.912645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] debug = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.912878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.912995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.913135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.913245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.913352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.913459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.913634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.913754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.913869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.913977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.914106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.914216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.914337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.914453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_config_append = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.914453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.914669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.914778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_dir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.914885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.915000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.915110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.915224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.915338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.915451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.915559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.915674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.915783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.915890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.915998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.916112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.916230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.916339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.916448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.916555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.916669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.916782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.916899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.917009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.917122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.917231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.917338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.917451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.917566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.917674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.917781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.917888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.917994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.918137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.918262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.918377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.918494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.918494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.918698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.918887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.918998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] publish_errors = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.919111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.919219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.919329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.919447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.919561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.919669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.919783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.919898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.920125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.920349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] standard_threads = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.920563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.920784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.920994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.921101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_journal = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.921208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.921322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_json = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.921444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.921558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_stderr = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.921558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] use_syslog = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.921766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.921879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 21 10:20:43.921987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.922924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.923855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.924936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.925923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.926964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.927980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.928939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.929915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.930944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.931927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.external = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.password = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.932917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] auth.token = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.933913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.934967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935522 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.935936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.936955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.937938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.938950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.939995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.940999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.941907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.942909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.943227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.943608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.943723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.943834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.943943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.944949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.945946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.external = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.946986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.password = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] auth.token = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.947944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.948843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.949898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.950932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.951923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.952931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.953956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.954892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.955905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.956992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.957998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.958124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.958234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.958355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.958545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.958797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.959907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.960895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.961917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.962968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.963959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.964961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.965954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.966962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.967952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.968945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969617 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.969945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.970970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.971962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.972959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.973950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.974115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.974666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.974809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.974925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.975918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.976902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.977910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.978945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.979976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.980942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80174) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.981849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.982700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.982700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.982700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.982700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.983105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.983214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.983383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.983616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.983855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.984086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.984339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.984595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.984845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.985084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.985322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.985555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.985791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.986030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.986300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.986538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.986794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.987042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.987281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.987525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.987768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.988015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.988252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.988490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.988724 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.988968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.989215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.989444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.989761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.990250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.990645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.990896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.991147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.991752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.992570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.992818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.993060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.993300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.993540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.993790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.994030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.994302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.994546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.994796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.995033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.995278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.995507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.995746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.995981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 21 10:20:43.996152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80175) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 21 10:20:44.010408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.010641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.010867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.019486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.022502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.022734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.022948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.031555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.047450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.047679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.049534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.049768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.193101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.193295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.242119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.242294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.242459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.242547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.306995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.307709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.331988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.332892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.333582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.344288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.344649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.357412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.357733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.357835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.357955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80174) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.358935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80175) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 21 10:20:44.376169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.376389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 10:20:44.376604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.376759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.376844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 10:20:44.376918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 10:20:44.377129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 21 10:20:44.377404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.377984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.378097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.378383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.388786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.389757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.390090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.397841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.398347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.401115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.401392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.401599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.401725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.401882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.401965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.402967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.403987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.404249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.430232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.430999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.431839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.432118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.432609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.432886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.437390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.437778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.438082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.438349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.438745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.439024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.445539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.445760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.446433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.446710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.450301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.450595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.450872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.451433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.451961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.452100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.452182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.452340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.452639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.452908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.453175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.470882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.471163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.471918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.472192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.475851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.477176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.479832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.480224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.481177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.481576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.485220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.486599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.488829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.490256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.492665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.492962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.493249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.493531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.493802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.493946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.494108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.494191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.494459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.494755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.495032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.495308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.513100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.513351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.513641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.513897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.514391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.514671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.514949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.515220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.521817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.523114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.523553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.523827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.524817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.525090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.527007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.527299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.527603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.527905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.528236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.528373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.528603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.528903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.529192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.529558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.541621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.541901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.542204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.542483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.543075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.543355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.543640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.543917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.544068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.544387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.544679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.545546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.545836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.546142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.562737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.564083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.566016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.567397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.569491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.570836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.571250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.572567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.572857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.573142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.573441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.574239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.574517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.574805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.580699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.582194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.582320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.583808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.585583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.585869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.586281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.586563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.587022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.587323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.587717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.587996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.595587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.595867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.596143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.597040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.597325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.597603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.604105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80174) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.604727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.605015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.605287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.605552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.605915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.606041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80175) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 21 10:20:44.606717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.606853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.606934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.606998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.607988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80174) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.608088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.608290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.608565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.608837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.609108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.609378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.609635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80175) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 21 10:20:44.645999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c870999c0 pid: 80174 (default app) Jun 21 10:20:44.648285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c870999c0 pid: 80175 (default app) Jun 21 10:20:44.649447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc46cf-5342-4483-b57d-2847083b813a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:44.649747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc46cf-5342-4483-b57d-2847083b813a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:44.650023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bc46cf-5342-4483-b57d-2847083b813a None None] PATH_INFO: `/v3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:44.654306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Jun 21 10:20:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:20:52.484854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:52.485450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:52.485450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:52.489833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:20:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:20:52.495834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:52.496274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:52.496388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:52.566267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: INFO dbcounter [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] Registered counter for database keystone Jun 21 10:20:52.588464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG oslo_db.sqlalchemy.engines [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80174) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:20:52.596280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writer thread running {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:20:52.775666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG passlib.handlers.bcrypt [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80174) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 10:20:52.776076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG passlib.handlers.bcrypt [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80174) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 10:20:52.830393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:20:52.831943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:20:52.964381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:20:52 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 10:20:53.111324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:53.183572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: INFO dbcounter [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] Registered counter for database keystone Jun 21 10:20:53.203332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG oslo_db.sqlalchemy.engines [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80175) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 21 10:20:53.210878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writer thread running {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 21 10:20:53.335063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b71865-10e1-4dc0-857e-536bea40affa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:53.339920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:53.340593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:53.340881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:53.341157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:53.350746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:53.403459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING keystone.common.rbac_enforcer.enforcer [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 10:20:53.403665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004ed2af-6ea1-496e-920f-e43af12cc99f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:53.414714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jun 21 10:20:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:20:53.420923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:53.436188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3bfc96-0dce-4c6b-8bc6-6bbbb551e5e5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:53.441221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:53.442390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:53.442788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:53.443137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] PATH_INFO: `/v3/projects/ebccc8110983425eae462769b51519c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:53.447429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] RBAC: Authorizing `identity:get_project(project_id=ebccc8110983425eae462769b51519c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:53.498010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 21 10:20:53.498732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc9997-a220-4cbd-a854-6ad6ca8ac503 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:53.503208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Jun 21 10:20:53 2022] GET /identity/v3/projects/ebccc8110983425eae462769b51519c6 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:20:55.544265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c79b-12fc-4ba1-98ea-9f5996f26984 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:55.544844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c79b-12fc-4ba1-98ea-9f5996f26984 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:55.544844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a07c79b-12fc-4ba1-98ea-9f5996f26984 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:55.549047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:20:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:20:55.555454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:55.555887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:55.556012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:55.576338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:20:55.577896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:20:55.587621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:20:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 21 10:20:55.611937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c79b-12fc-4ba1-98ea-9f5996f26984 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:55.628774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a07c79b-12fc-4ba1-98ea-9f5996f26984 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:55.634145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:55.634796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:55.635080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:55.635358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:55.643662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:55.645499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307d101-f209-4308-a89a-ea10b614fd3b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:55.654595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jun 21 10:20:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:20:55.660760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:55.671120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f360b434-3957-4e76-bbbc-4998ae31d200 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:55.677075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:55.678080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:55.678393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:55.678677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:55.680352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:55.682297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af061bf3-2569-48c5-9ed5-980ba4cc1db7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:55.684001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Jun 21 10:20:55 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:20:57.760208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d5c-eae0-40c0-b835-ec38199a0b0f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:57.760799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d5c-eae0-40c0-b835-ec38199a0b0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:57.760799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db3d5c-eae0-40c0-b835-ec38199a0b0f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:57.762150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:20:57.767626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:57.768062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:57.768165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:57.786219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:20:57.787521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:20:57.797121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb64ef-27b4-41bf-954c-91e3fb070ce3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:57.797416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb64ef-27b4-41bf-954c-91e3fb070ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:57.797698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb64ef-27b4-41bf-954c-91e3fb070ce3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:57.799100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:20:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:20:57.804207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:57.804495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:57.804781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:57.846980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80175) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 21 10:20:57.847405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG passlib.handlers.bcrypt [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80175) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 21 10:20:57.876658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:20:57.892945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:20:57.894591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:20:57.900426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:57.924877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:57.997446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:20:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:20:58.006574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662f9e6d-ae05-4b5b-94c0-34b4bd4b3304 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.019606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.041416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.042286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.042575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.042853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.054557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:20:58.065918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:20:58.066892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:20:58.068139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:20:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:20:58.073460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.128043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4423312-d010-4237-ad34-f19d0d51b03c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.131223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.160903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.169965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.170926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.171215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.171490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.180695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5ffcd2-c11e-4cc7-9853-a3a62d51b27f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.214932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.215655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.215935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.216213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.216990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:20:58.217299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.218759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.231205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:20:58.236853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.239241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.240968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.339268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d612fe-ecc8-4071-8201-7f4fd0ac0be7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.342473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 10:20:58.348175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.350995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.374351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.375242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.375530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.375807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.377077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.378618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.380329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:20:58.386014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.401294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.449274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25412174-fd96-4bf2-882d-2a1b09cbb0af None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.484055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.484860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.485133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.485406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.487286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36b912-e022-48af-9205-063996b2c016 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.504727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.506607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.524124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.524848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.525136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.525417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.526656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.528138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.529766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:20:58.530132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:20:58.531052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:20:58.532030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:20:58.532030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:20:58.532030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:20:58.532030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:20:58.532030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:20:58.535846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.538166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:20:58.595513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.621470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:20:58.640737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332144-8cc1-4ef5-a442-a19dba14b00c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.642143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8be660-0154-4090-bcbd-62d9036b604a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:20:58.677309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.677787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:20:58.677978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.678293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.678497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:20:58.678582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.678776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:20:58.679047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:20:58.679402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.domain.id=default, user.id=b6ff555140924a9182c287c0588e7e67) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:20:58.679717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.679798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:20:58.680077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:20:58.681189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1df7ff-c82a-4086-8623-890963e3c0da None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.681474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3944793-a299-4d41-bd38-ab219ff88478 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:20:58.688385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/role_assignments?user.id=b6ff555140924a9182c287c0588e7e67&scope.domain.id=default&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:20:58.701725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:20:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:00.940265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872fc4-53d6-4cd6-8f33-d32fd8e967d8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:00.941205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872fc4-53d6-4cd6-8f33-d32fd8e967d8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:00.941770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8872fc4-53d6-4cd6-8f33-d32fd8e967d8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:00.943531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:00.949524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ae0-bcab-4c56-9b4d-54f1d71d6fe8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:00.950406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ae0-bcab-4c56-9b4d-54f1d71d6fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:00.950877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d81ae0-bcab-4c56-9b4d-54f1d71d6fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:00.979699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1d81ae0-bcab-4c56-9b4d-54f1d71d6fe8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:00.981233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1d81ae0-bcab-4c56-9b4d-54f1d71d6fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:01.074505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:01.119615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872fc4-53d6-4cd6-8f33-d32fd8e967d8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.262847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8872fc4-53d6-4cd6-8f33-d32fd8e967d8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:01.289828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68eb-ee67-453d-83d5-15072476022b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.290497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68eb-ee67-453d-83d5-15072476022b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db68eb-ee67-453d-83d5-15072476022b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.292568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 12/24] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:01.298327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e3e-a5d2-4356-a10f-341c4f4b3f3a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.298935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e3e-a5d2-4356-a10f-341c4f4b3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.299436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee9e3e-a5d2-4356-a10f-341c4f4b3f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.313132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:01.313948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.314256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.314531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.334813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:01.335497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4aee9e3e-a5d2-4356-a10f-341c4f4b3f3a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:01.336924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4aee9e3e-a5d2-4356-a10f-341c4f4b3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-dd6ed114-2011-4de4-a7d6-94b5a09018b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:01.342864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:01.343793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:01.344557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:01.346963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 13/25] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:01.349957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991e7c-4213-4639-8776-af7508f2ccfd None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.350425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991e7c-4213-4639-8776-af7508f2ccfd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.350857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71991e7c-4213-4639-8776-af7508f2ccfd None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.352995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:01.354882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71991e7c-4213-4639-8776-af7508f2ccfd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.366484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:01.464681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:01.496222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71991e7c-4213-4639-8776-af7508f2ccfd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:01.535679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:01.536475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.536768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.537051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.537949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:01.538294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:01.539750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:01.543482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:01.544835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.545128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.545410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.549875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 15/28] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:01.555906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.583338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:01.584597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:01.629985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:01.672338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 14/29] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:01.673574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.698798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cb96b-813b-42b9-953e-338a68b772c4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:01.754293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:01.755943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.756226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.756657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.758342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:01.760579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c3e70-0f53-4c72-9124-b2c72d14f6ea None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:01.763210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 16/30] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:01 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:01.767482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86590a63-a201-4c8d-921d-f01ac403686a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.767810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86590a63-a201-4c8d-921d-f01ac403686a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.768092 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86590a63-a201-4c8d-921d-f01ac403686a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.770361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 17/31] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:01.771130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86590a63-a201-4c8d-921d-f01ac403686a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.817433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e552474-5341-43fe-ae6b-d59d058fcf58 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:01.825695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:01.856321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:01.857138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.857421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.857698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.870086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:01.871623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:01.887466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86590a63-a201-4c8d-921d-f01ac403686a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:21:01.891018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:01.891796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:01.892595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:21:01.892595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:21:01.892595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:21:01.892595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:01.892595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 15/32] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:01.898072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:01.933565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:01.934635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:01.934929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:01.935478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:01.936319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:01.938614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf56c52-b7d1-4fd8-b8f0-ef8c605c714d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:01.942782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:02.045194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd8ec60-0632-41b0-895b-defeb7dafcc5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:02.071444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 18/33] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jun 21 10:21:01 2022] POST /identity/v3/roles => generated 225 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:02.072915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.073205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.073490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.105122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:02.109515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:02.128509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:02.129352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.129632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.130106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.135391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:02.138852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:02.143547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 16/34] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:02.144953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:02.217048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:02.243346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 19/35] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:02.244274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:02.352417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3e4c8-1b50-416d-b250-da7a3d676c91 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:02.391377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:02.392124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.392413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.392693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.393449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:02.393765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:02.395230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:02.400418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c694f0-a678-4b13-9094-1b0887d5defc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:02.413442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 17/36] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:02.419149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:02.431446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:02.450516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:02.451424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.451709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.451986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] PATH_INFO: `/v3/domains/default/users/b6ff555140924a9182c287c0588e7e67/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.454169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b6ff555140924a9182c287c0588e7e67, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:02.455736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:02.486669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 20/37] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jun 21 10:21:02 2022] PUT /identity/v3/domains/default/users/b6ff555140924a9182c287c0588e7e67/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:02.487909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:02.597461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:02.626265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35197c2-81c6-4879-9abc-5f2663733c6c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:02.654376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e62f7-240d-460a-bdd9-1f6a99a29b9e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:02.702467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:02.703157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.703440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.703717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.704457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:02.705974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b14e1-9a71-41e8-a307-bd7d88fccd34 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:02.715881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:02.715881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.715881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.715881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.716292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:02.716292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518406a7-44fc-4014-a3fa-808744957bbf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:02.745646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 21/38] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:21:02 2022] POST /identity/v3/projects => generated 301 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:02.747202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41c99-e974-4856-b835-b0eef5ebab11 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.747541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41c99-e974-4856-b835-b0eef5ebab11 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.747831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a41c99-e974-4856-b835-b0eef5ebab11 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.749444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 22/39] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:02.756805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.757178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.757522 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.780521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:02.782024 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:02.822750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:02.883931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 18/40] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jun 21 10:21:02 2022] POST /identity/v3/roles => generated 219 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:02.901899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaf3d-f2a0-4ba8-b2f3-e4f53b58fce9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.902280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaf3d-f2a0-4ba8-b2f3-e4f53b58fce9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.902505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaf3d-f2a0-4ba8-b2f3-e4f53b58fce9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.904535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 19/41] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:02.913765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:02.913765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:02.913765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:02.935367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:02.937609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:03.011664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 23/42] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:03.035323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 20/43] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:03.046951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:03.062287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:03.186616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:03.192768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec923b08-d070-476b-aff9-297332aa74d2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:03.225150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169e4e4-4dd9-4f54-afc7-463c5b0ec4f0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:03.243708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:03.244177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:03.244465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:03.244743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:03.245535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:03.247199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:03.265331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 24/44] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jun 21 10:21:03 2022] POST /identity/v3/roles => generated 223 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:03.276345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:03.277376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:03.277666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:03.277941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:03.279446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:03.281913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6f973f-26e0-4ebc-89df-48f8b1249c11 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:03.283522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 21/45] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:03.291597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:03.327230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:03.417802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d994d7-994c-4abf-a777-5bc5fd4d014b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:03.456402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:03.456998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:03.457282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:03.457560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:03.458454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:03.459957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08493af-c0a5-437d-badf-b89bc193572a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:03.489573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 25/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:21:03 2022] POST /identity/v3/projects => generated 312 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:21:04.933889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3756-c641-4d45-a9a7-828b5a5aa6a0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:04.934504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3756-c641-4d45-a9a7-828b5a5aa6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:04.934504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a3756-c641-4d45-a9a7-828b5a5aa6a0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:04.935921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 22/47] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:04.941936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:04.942561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:04.942699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:04.961388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:04.962652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:05.041521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 26/48] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:05.065281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a3756-c641-4d45-a9a7-828b5a5aa6a0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.171193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a3756-c641-4d45-a9a7-828b5a5aa6a0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.212145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.213435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.213947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.214504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.230887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:05.240056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:05.240948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:05.241955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 23/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:05.247723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.259503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:05.358642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3d0c7-df4a-41ef-a0b8-dcb4b2911825 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.394526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857285-8121-4948-aca6-acd535916dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.395203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857285-8121-4948-aca6-acd535916dab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.395489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857285-8121-4948-aca6-acd535916dab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.395779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5857285-8121-4948-aca6-acd535916dab None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.396546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857285-8121-4948-aca6-acd535916dab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:05.396843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857285-8121-4948-aca6-acd535916dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:05.398293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5857285-8121-4948-aca6-acd535916dab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:05.406725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 27/50] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:05.412449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.417327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:05.517990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd4466-17e8-4a69-9caa-9cac10d8f749 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.553239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.554157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.554420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.554689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.556187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:05.557665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f3e201-d81c-4740-bba9-2b92d3c46c9d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:05.559376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 24/51] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:05.565111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857285-8121-4948-aca6-acd535916dab None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.593914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a05d-e979-41bf-ab1d-3348402267ad None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.594261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a05d-e979-41bf-ab1d-3348402267ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.594542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd9a05d-e979-41bf-ab1d-3348402267ad None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.595931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 25/52] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:05.601535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.601829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.602147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.620141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:05.621369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:05.641318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:05.673886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5857285-8121-4948-aca6-acd535916dab None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.693298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 26/53] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:05.712169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.712973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.713260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.713539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.714776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:05.716452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:05.716972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.718158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:05.719382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:05.723789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.819625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceef635-de96-4347-a3f5-f80e7cf5f4b7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.825985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89b299-abfd-41c8-ad21-3c802918e7a2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:05.853856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.855068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.855352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.855620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.856824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:05.858356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:05.860025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:05.860369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:05.861034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:05.861318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:05.861594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:05.862467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.domain.id=default, user.id=b6ff555140924a9182c287c0588e7e67) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:05.862776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:05.864258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fbe49b-c1d0-4a55-9eb0-abb9f7084267 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:05.865935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:05.870519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 29/56] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jun 21 10:21:05 2022] GET /identity/v3/role_assignments?user.id=b6ff555140924a9182c287c0588e7e67&scope.domain.id=default&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:05.946807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:05.982866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547dd5d-c7fa-400d-8c9c-d67c53097818 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:06.132798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:06.133399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:06.133683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:06.133957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:06.134717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:06.136256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0551a2-700e-4913-92d7-017b99acb489 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:06.165780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 28/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jun 21 10:21:05 2022] POST /identity/v3/projects => generated 298 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:21:08.191822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f360-e286-4474-ad9c-748f66dab8d8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:08.192462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f360-e286-4474-ad9c-748f66dab8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:08.192462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f360-e286-4474-ad9c-748f66dab8d8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:08.193746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:08.199441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:08.199847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:08.200002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:08.218268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:08.219485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:08.291984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:08.316984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f360-e286-4474-ad9c-748f66dab8d8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:08.320438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:08.431361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f360-e286-4474-ad9c-748f66dab8d8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:08.470510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:08.471239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:08.471519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:08.471778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:08.472951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:08.475027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c1c208-5d1b-4004-9f1e-3ce1966fb6b3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:08.476647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:08.482829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:08.550135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:08.601049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872bf73-7126-4884-a261-fc0126571d87 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:08.639857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:08.640561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:08.640848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:08.641132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:08.641892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:08.643504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdada20-5edf-40cc-b8dd-3bd98ec80f8f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:08.674299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:08 2022] POST /identity/v3/users => generated 275 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:21:11.984414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c77c-6e15-4202-bbff-ac00f5318d68 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:11.985865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c77c-6e15-4202-bbff-ac00f5318d68 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:11.986643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087c77c-6e15-4202-bbff-ac00f5318d68 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:11.989516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:11.996548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d3c5-101a-44c9-8753-4b11e9827d8f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:11.997986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d3c5-101a-44c9-8753-4b11e9827d8f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:11.998723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791d3c5-101a-44c9-8753-4b11e9827d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.036525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f791d3c5-101a-44c9-8753-4b11e9827d8f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:12.038931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f791d3c5-101a-44c9-8753-4b11e9827d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:12.152132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 31/63] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:12.221558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087c77c-6e15-4202-bbff-ac00f5318d68 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:12.288179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80743-2cfe-4477-b2c9-eba28298f0b0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.288823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80743-2cfe-4477-b2c9-eba28298f0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.289297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f80743-2cfe-4477-b2c9-eba28298f0b0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.291140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 32/64] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:12.307436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c267-4890-4ba9-a145-0e3d0887db16 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.308008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c267-4890-4ba9-a145-0e3d0887db16 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.308491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c267-4890-4ba9-a145-0e3d0887db16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.340578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a252c267-4890-4ba9-a145-0e3d0887db16 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:12.342448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a252c267-4890-4ba9-a145-0e3d0887db16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:12.382208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:12.435969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:12.451880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087c77c-6e15-4202-bbff-ac00f5318d68 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:12.512593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:12.513610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.513987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.514397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.527705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:12.531232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:12.533714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78278c-bfe1-40c5-b92c-4bcdcd8715b6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.534503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78278c-bfe1-40c5-b92c-4bcdcd8715b6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.535129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78278c-bfe1-40c5-b92c-4bcdcd8715b6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3d88599d-6db0-483e-8262-ac4581f5e114 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:12.536370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:12.538213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:12.539722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:12.541235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 33/66] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:12.542971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 34/67] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:12.556055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564541-ee21-4ebe-ba60-9ee469a74320 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.556331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78278c-bfe1-40c5-b92c-4bcdcd8715b6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:12.556452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564541-ee21-4ebe-ba60-9ee469a74320 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.556745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3564541-ee21-4ebe-ba60-9ee469a74320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.575587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b3564541-ee21-4ebe-ba60-9ee469a74320 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:12.577093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b3564541-ee21-4ebe-ba60-9ee469a74320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:12.661923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 34/68] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:12.663755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb746-5256-4e61-bb10-94e14d62551a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.663936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb746-5256-4e61-bb10-94e14d62551a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.664208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bb746-5256-4e61-bb10-94e14d62551a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.665804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 35/69] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:12.666681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bb746-5256-4e61-bb10-94e14d62551a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:12.766717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78278c-bfe1-40c5-b92c-4bcdcd8715b6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:12.778622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:12.814213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:12.815239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.815514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.815796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.816607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:12.816916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:12.819419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a793c-b327-449e-aa51-54a3e363c73c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:12.835373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 35/70] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:12.837138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.837430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.837708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.852418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bb746-5256-4e61-bb10-94e14d62551a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:12.860312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:12.861599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:12.898474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:12.906225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:12.907080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:12.907367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:12.907752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:12.921667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:12.930801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:12.937778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 36/71] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:12.938603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:12.978154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 36/72] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:12.978154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.117257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c009d28-d188-427c-b193-5a02d5601db8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.152863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162f28-d28c-4da8-820d-189e9e6cc813 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.154030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.180234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.181528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.181939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.182409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.200523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:13.203022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.204243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.204707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.205144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:13.214703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:13.215759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:13.216654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:13.218755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:13.218755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.233300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.234872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.241587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 37/74] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:12 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:13.241587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.276503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.371907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c667ef-b445-4875-bb5d-c58b1a076b33 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.399338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a5a57-8017-4751-91ee-87a386b285c3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.418034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.419297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.419732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.420148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.422252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.424430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.426306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:13.427797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.456515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.457202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.457489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.457777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.458718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:13.459033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.460523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.470131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 38/76] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:13.471024 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.521244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.542130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.561310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5aa33-8e38-4cbf-bc71-82be7cc991e5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.593290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec6457-5b19-4e02-a33c-1282a0ded9a4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.606498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.607185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.607472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.607754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.608526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:13.608841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.610334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25913b20-5475-4e97-86a3-0394a02a6429 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.619993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:13.621441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ce6-1f49-4b8e-bfc9-f64a23064c29 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.621749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ce6-1f49-4b8e-bfc9-f64a23064c29 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.622132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a9ce6-1f49-4b8e-bfc9-f64a23064c29 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.623392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 40/78] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:13.624123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a9ce6-1f49-4b8e-bfc9-f64a23064c29 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.652471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.653144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.653428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.653710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.758997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.760984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.770849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a9ce6-1f49-4b8e-bfc9-f64a23064c29 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:13.812819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:13.813901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.814044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:13.814495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:13.814994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:13.816443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:13.820289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:13.851497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 41/79] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:13 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:13.852774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:13.859105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:13.892773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 39/80] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:13.893694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:14.005659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cdc6b-622b-46b3-aff0-7f139dec5e68 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:14.035347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878af0a-132c-47ed-97db-cee1c6b5a2b6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:14.056365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:14.057123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.057426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.057718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.059189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:14.060764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6464198-3a9f-4408-9a86-f91dfc5740e7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:14.062636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 42/81] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:14.070392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.070392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.070392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.088096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:14.089512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:14.091219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:14.092170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.092465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.092739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.094179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:14.095762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:14.099022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 40/82] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:13 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:14.099022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:14.117199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:14.213488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 43/83] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:14.214119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:14.218646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:14.255789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7719-6aa7-40df-a65d-e6e96a1754b3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:14.325804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:14.327382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.327874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.328375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.330589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:14.333494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:14.342926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 41/84] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:14 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:14.343770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:14.367571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79665b-c826-4b21-82bd-81ca1e57b3eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:14.432345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:14.433459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.433930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.434443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.509456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:14.566932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f7bd4-4dab-43e7-b51c-89ec67a839ff None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:14.577339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:14.580123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:14.584139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:14.645109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:14.646796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:14.647876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:14.648334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:14.782936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:14.785890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:14.797514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 44/85] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:14.806078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:14.938953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:14.980431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 42/86] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:14.982023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.028414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a228b0-1fb7-4cc3-8f82-bcdc586a42ef None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.031297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:15.102636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.104582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.105074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.105559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.127544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:15.144987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:15.146308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:15.147066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:15.150837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 45/87] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:15.156007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.166943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556334df-70c3-4afa-b919-1fe40bffbff1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.228812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25192478-245e-4234-8235-30bdb6703eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.230287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192478-245e-4234-8235-30bdb6703eed None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.230919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192478-245e-4234-8235-30bdb6703eed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.231246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25192478-245e-4234-8235-30bdb6703eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.233534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25192478-245e-4234-8235-30bdb6703eed None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:15.233534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25192478-245e-4234-8235-30bdb6703eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:15.235687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25192478-245e-4234-8235-30bdb6703eed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:15.246194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 43/88] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:14 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:15.247795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25192478-245e-4234-8235-30bdb6703eed None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.334394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:15.392908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e72ae6-ce0b-4332-8735-8208641c97d8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.500605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.502566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.504217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.505038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.507499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:15.510971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:15.514902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 46/89] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:15 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:15.522090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.548640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25192478-245e-4234-8235-30bdb6703eed None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.601463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:15.649469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.650781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.651279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.651711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.656013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:15.658507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:15.662777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 44/90] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:15 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:15.666926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.802015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b095ee-f47a-467b-aea2-8ebb464aaada None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.904625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95257d16-57d1-4762-a571-b008f935cc24 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:15.927294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.928512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.928854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:15.929019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.929512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.931029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:15.931606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:15.934414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:15.970262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 47/91] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 455 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:15.973105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:15.980836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:15.982362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:15.983118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:15.983825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:15.985735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=b6ff555140924a9182c287c0588e7e67) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:15.986572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:15.989697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:16.001583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 45/92] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:15 2022] GET /identity/v3/role_assignments?user.id=b6ff555140924a9182c287c0588e7e67&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:16.003449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:16.217212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887eef8-b9f5-4c8b-b935-dd320d1bcbc0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:16.254689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:16.294457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8e22d-99a8-4866-9866-f049a6af32d1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:16.300924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:16.300924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:16.300924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:16.300924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:16.303271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:16.305948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:16.309069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:16 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:16.319024 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:16.412360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:16.414881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:16.415639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:16.417068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:16.419352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:16.420430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:16.424797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:16.439675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:16.448220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:15 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 259 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:16.541645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15734116-cc0d-4f2d-a91d-ee773e99b86d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:16.593118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:16.593795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:16.594106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:16.594392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:16.686548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:16.688104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c58799d-6070-44f1-9ac2-c48b125537df None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:16.755034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:16.835262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:16.842032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:16.861919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ea0d-4bc4-43bc-9e1b-1237888b50ff None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:16.862339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ea0d-4bc4-43bc-9e1b-1237888b50ff None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:16.862553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6ea0d-4bc4-43bc-9e1b-1237888b50ff None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:16.863945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 48/96] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:16.872772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:16.872772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:16.872772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:16.890443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:16.891777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:16.978004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940d3bb-773f-43d1-b98b-b686bb2dbaf0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:16.980568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 49/97] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:17.006570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:17.029941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:17.033588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.034464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.036776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] PATH_INFO: `/v3/projects/fe8f017cb20e47bdab5611c31e866a29` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.043064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] RBAC: Authorizing `identity:get_project(project_id=fe8f017cb20e47bdab5611c31e866a29)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:17.046417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:17.048692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 49/98] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:16 2022] GET /identity/v3/projects/fe8f017cb20e47bdab5611c31e866a29 => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:17.057266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:17.111581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:17.142472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:17.206594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6ce64-8f6e-4897-848e-86881aee69cb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:17.245330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:17.246192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.246481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.246759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.258376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-1adc564b-9be0-4fbf-9725-a70093409b73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:17.266711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:17.267631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:17.268390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 50/99] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:17.269576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b8cf-d31a-41ac-8f78-342927c4c1ee None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.269726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b8cf-d31a-41ac-8f78-342927c4c1ee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.270533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb7b8cf-d31a-41ac-8f78-342927c4c1ee None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.275720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 51/100] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:17.277326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7b8cf-d31a-41ac-8f78-342927c4c1ee None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:17.359033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6112a-dec3-4fcb-95d3-e9af91ba2e50 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:17.423579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:17.424210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.424454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.424723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.425601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=fe8f017cb20e47bdab5611c31e866a29, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:17.425915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:17.427934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc237d-b8f3-4da8-a5c2-8379e38ea5b4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:17.445750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 50/101] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:17 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=fe8f017cb20e47bdab5611c31e866a29&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 259 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:17.448126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.448615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.449077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.509336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:17.514226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:17.645202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb7b8cf-d31a-41ac-8f78-342927c4c1ee None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:17.761660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:17.778179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 51/102] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:17.780153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:17.781335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:17.781838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:17.784970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:17.784970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:17.784970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:17.792799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:17.812189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 52/103] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 536 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:17.820383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:17.850210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:17.898295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:18.155336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9835a8-3de8-43e4-baca-b3660da56435 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:18.163287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45504e4-5f20-4d24-9463-5645f028d585 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:18.233415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:18.234658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:18.235176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:18.235653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:18.237113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:18.238848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:18.240944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 53/104] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:18.267240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:18.302091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:18.302091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:18.302091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:18.302091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] PATH_INFO: `/v3/users/f83b63a8c1f748209f3b8fa64982ba29` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:18.370668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] RBAC: Authorizing `identity:get_user(user_id=f83b63a8c1f748209f3b8fa64982ba29)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:18.373557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:18.390214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 52/105] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:17 2022] GET /identity/v3/users/f83b63a8c1f748209f3b8fa64982ba29 => generated 289 bytes in 564 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:18.391950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:18.468813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:18.620634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932f41f7-4073-443f-955f-0bc4a060dddc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:18.646479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:18.702679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee4557-7c6d-49f6-994d-8a02e2aa97cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:18.735287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:18.736845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:18.737336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:18.737814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:18.738829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:18.740693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:18.824061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 54/106] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:21:18 2022] POST /identity/v3/projects => generated 302 bytes in 557 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:18.836649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:18.837805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:18.838355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:18.838854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:18.935514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:18.937603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:19.060161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:19.109893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 53/107] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 719 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:19.118498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:19.292330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13b5ba-f1d6-4351-af26-78e1bd847b19 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:19.313887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:19.342688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:19.343584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:19.343871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:19.344151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:19.351012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:19.352548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7937db6-b5a4-4e03-ac01-6147632f6088 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:19.355071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 55/108] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:19 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:19.365068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:19.543638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2fa5-2f2e-44c0-a419-82228ee7f006 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:19.544144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2fa5-2f2e-44c0-a419-82228ee7f006 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:19.544536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de2fa5-2f2e-44c0-a419-82228ee7f006 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:19.546911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 56/109] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:19.557820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:19.558340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:19.558787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:19.610771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:19.612651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:19.628320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7defd5-d6e6-4744-b8c3-02c2bf4de557 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:19.746824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:19.747848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:19.748722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:19.770501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:19.772222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=f83b63a8c1f748209f3b8fa64982ba29) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:19.772746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:19.775324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:19.805422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 54/110] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:19 2022] GET /identity/v3/role_assignments?user.id=f83b63a8c1f748209f3b8fa64982ba29&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 259 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:19.894321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 57/111] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:19.958032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:20.017227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:20.092428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be60afaa-55e0-4def-9b23-8382d70405da None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:20.139041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:20.139885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:20.140171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:20.140454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:20.153802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:20.166790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:20.168398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:20.169856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 55/112] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:20.187960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:20.476677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3f501-5a6f-405f-aba0-4c2f13c7458c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:20.511269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:20.565842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:20.566920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:20.568395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:20.568878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:20.570210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:20.570760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:20.573266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:20.603262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 58/113] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:20.611930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:20.769410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3692e-88d9-4ae4-b728-bb86979ed248 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:20.782700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:20.824726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:20.825666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:20.825960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:20.826282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:20.830949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:20.832486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d577e0e-5773-495d-815d-0a0448779031 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:20.834484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 56/114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:20 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:20.843971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:21.016365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73368-60ee-4680-8e19-cb6016ce1001 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.017074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73368-60ee-4680-8e19-cb6016ce1001 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.017569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c73368-60ee-4680-8e19-cb6016ce1001 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.019192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 57/115] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:21.025350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.025987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.026498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.044272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:21.045820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:21.096207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c3936-ac43-4d0d-98a7-9024627f58d5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:21.169270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:21.171223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.171973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.172739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.179325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:21.182340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:21.185825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 59/116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:20 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:21.187958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 58/117] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:21.198236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:21.232205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:21.337530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:21.436137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:21.440755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da43a92d-3b2b-49da-a639-4b2af10aef96 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:21.451131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e054c424-3e2a-423a-be88-de5e92391e0e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:21.488553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:21.489620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.489959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.490205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/62b75aba48374a829d632b243d81c776/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.491003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:21.492032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.492267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, user_id=62b75aba48374a829d632b243d81c776, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:21.492712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.493177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.493761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbb758-f245-4cc6-8861-7c7ba9221873 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:21.507602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:21.509835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 60/118] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:21 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/62b75aba48374a829d632b243d81c776/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:21.515521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1dded-18b2-475a-9f8a-bfa9d26cb101 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.515802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1dded-18b2-475a-9f8a-bfa9d26cb101 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.516073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1dded-18b2-475a-9f8a-bfa9d26cb101 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2aed437b-dbe9-451f-90a3-8c2f8c00e00d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:21.516847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:21.517725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:21.518518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:21.519102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 61/119] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:21.519102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6eac6-1e8a-404b-b68d-192f72fa4ec5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.519102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6eac6-1e8a-404b-b68d-192f72fa4ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.519284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6eac6-1e8a-404b-b68d-192f72fa4ec5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.521664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 59/120] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:21.522336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 62/121] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:21.533914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.535263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:21.535662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.536005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.539656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:21.539656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:21.572816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:21.574034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:21.575641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:21.576980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:21.719520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 63/122] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:21.720974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:21.750208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 60/123] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:21.758372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:21.779627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:21.960672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555b0da-2d65-4959-a8c3-18dc9f1869cc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:21.988899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:22.022421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1589602-d910-4c9e-8c65-bf2ecf253aaf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:22.032060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.038251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.038562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.038817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.039654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:22.039972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:22.041503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:22.058761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 64/124] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:22.059488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.082734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.083581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.083867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.084151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.101974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:22.114896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:22.115836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:22.116596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:22.117663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 61/125] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:22.119645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.289901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df12a3-3715-4533-958d-71dc84e71404 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:22.318714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:22.338407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af4d95-12cc-44ec-9294-5fbabba27fd4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:22.417575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.420159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.420448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.420728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.423494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:22.425230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:22.429916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 62/126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:22.430582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.446385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.447233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.447543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.447823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.466418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:22.469860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:22.478537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:22.479803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:22.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 65/127] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 421 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:22.481199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.638093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162708d-72fb-4102-835a-d744d6752190 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:22.681276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4f5c6-ad1c-46a6-8b5f-c6c59e74a64f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:22.713010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.713706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.713995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.714303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.715073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:22.715390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:22.716807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:22.739876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 63/128] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:22.740808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.763485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:22.766089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:22.766089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:22.766089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] PATH_INFO: `/v3/projects/fe8f017cb20e47bdab5611c31e866a29` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:22.770101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] RBAC: Authorizing `identity:get_project(project_id=fe8f017cb20e47bdab5611c31e866a29)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:22.770101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:22.770843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 66/129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/projects/fe8f017cb20e47bdab5611c31e866a29 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:22.771641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:22.834743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:22.908468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:22.963340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4580a33-c2a7-4149-b4cd-ff9dc51810a1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.032316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b38f9-1b03-4329-935b-8a223153db86 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.055261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.056694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.057152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.057614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.058600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:23.059094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.060784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.075053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 64/130] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:23.078948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.108027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.109246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.109905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.111084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.113523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.115467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.118823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 67/131] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:22 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:23.120871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.246412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:23.255025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14a55f-2ac1-45c7-b5d6-a5661181b3c6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.262111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bfa90-3960-4638-a9e9-be020f624888 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.297828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.298781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.299071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.299359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] PATH_INFO: `/v3/projects/fe8f017cb20e47bdab5611c31e866a29/users/62b75aba48374a829d632b243d81c776/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.301107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.301420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] RBAC: Authorizing `identity:create_grant(project_id=fe8f017cb20e47bdab5611c31e866a29, user_id=62b75aba48374a829d632b243d81c776, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.302222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.302727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.303053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.303553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1e9fa-7e36-4681-9eb9-abd0c3a889cf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.304481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.306004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.307998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 68/132] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:23 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:23.313666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.317026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:23.322111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 65/133] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:23 2022] PUT /identity/v3/projects/fe8f017cb20e47bdab5611c31e866a29/users/62b75aba48374a829d632b243d81c776/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:23.323907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183baa-a1c4-48cd-be64-90188db8f04b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.324650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183baa-a1c4-48cd-be64-90188db8f04b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.325152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd183baa-a1c4-48cd-be64-90188db8f04b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.331555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 66/134] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:23.333658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88886b6-43c3-485c-a94b-24b88dbfca80 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.334257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88886b6-43c3-485c-a94b-24b88dbfca80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.334736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88886b6-43c3-485c-a94b-24b88dbfca80 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.336882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 67/135] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:23.337978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88886b6-43c3-485c-a94b-24b88dbfca80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.469284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f326632-30f8-4704-b01f-8eedb3648ad3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.485105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88886b6-43c3-485c-a94b-24b88dbfca80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.528088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.528896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.529177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.529453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.530722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.532205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8899ae0-a573-43e4-8662-e67aa1224e25 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.533939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 69/136] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:23 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:23.535195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.535478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.535755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.536828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.538168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.538816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.539269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.540775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.542482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f95ae2-a6e3-44b0-ae6a-64f3edbc6696 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.544690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 68/137] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:23 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:23.546156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.546597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.547204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.556060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:23.557263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:23.573792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:23.576002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:23.581771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:23.639205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 70/138] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:23.639937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.681730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:23.689418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 69/139] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:23.690737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.796203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3bfcc-bc3d-481c-bf3f-0a6fdad25185 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.826515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32708769-87da-4799-b7e0-0a1aedf33ae1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:23.837579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.838575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.838859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.839132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/b6ff555140924a9182c287c0588e7e67/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.841403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, user_id=b6ff555140924a9182c287c0588e7e67, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.842952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.858971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 71/140] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:23 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/b6ff555140924a9182c287c0588e7e67/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:23.860682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:23.878532 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:23.879736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:23.880071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:23.880501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/62b75aba48374a829d632b243d81c776/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:23.883766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, user_id=62b75aba48374a829d632b243d81c776, role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:23.885623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:23.887699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:23.907877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 70/141] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:23 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/62b75aba48374a829d632b243d81c776/roles/bacfbe396cb341d7a82bead66b616b8f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:23.914519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.023765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981a697-ef06-4822-8262-5e318a7bb3f1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.064144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.065171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.066934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.067514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.068414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:24.069075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:24.074067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184e434-430a-4352-b017-fa4dcc653c68 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:24.074067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 72/142] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:24.074067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd9f1c-8f38-48e5-820b-3b230e382f51 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.074067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd9f1c-8f38-48e5-820b-3b230e382f51 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.074621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd9f1c-8f38-48e5-820b-3b230e382f51 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.076760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 73/143] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:24.086233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.086506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.086782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.133535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:24.134395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5e0200-ec3b-465b-8702-6793bae13c5c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.135557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:24.181215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.182106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.182855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.183148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.196827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:24.207498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:24.209649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 71/144] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:24.210990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.288913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 74/145] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:24.290942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.320463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:24.332837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20e016-e813-4a4d-a9ce-63f31f36e5e4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.352819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:24.371296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.371990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.372269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.372544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.373275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:24.376084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:24.413395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 72/146] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:24 2022] POST /identity/v3/users => generated 283 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:24.414329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.502105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ef7275-446b-47ff-b6a9-2f3693c1bfea None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.558087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.559287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.559588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.559865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.560643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:24.560949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:24.562712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:24.579034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 75/147] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:24.588562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.773087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:24.791132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fc325-cb30-471d-90e6-0f2cd82aaaa5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.824646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1bee8-0cb9-4d98-ac23-bd1e784c8923 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:24.865070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.866961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.867496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.868003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.888282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:24.889555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:24.890026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:24.890764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] PATH_INFO: `/v3/users/f83b63a8c1f748209f3b8fa64982ba29` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:24.892344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] RBAC: Authorizing `identity:get_user(user_id=f83b63a8c1f748209f3b8fa64982ba29)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:24.902086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:24.904686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 76/148] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:24 2022] GET /identity/v3/users/f83b63a8c1f748209f3b8fa64982ba29 => generated 289 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:24.905658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:24.910434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:24.913835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:24.915594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:24.917124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 73/149] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:24.927343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:24.989389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:25.085778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63261410-5adc-4ba0-b41e-0c6380a7dc05 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:25.127324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:25.128124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:25.128412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:25.128687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:25.129941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:25.130301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:25.131928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:25.141895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 74/150] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:25.150222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:25.203590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fa832-6ff3-4b72-b6c8-31d31d21535b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:25.273018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05381e2f-0cfa-4c5c-a90a-a4325b2581e2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:25.278841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:25.279748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:25.280035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:25.280318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:25.282880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:25.287005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:25.288660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:25.290616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 77/151] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:24 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:25.299062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:25.346358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:25.350337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:25.352365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:25.353160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:25.354393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:25.357076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:25.360342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:25.363935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 75/152] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:25 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:25.371728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:25.601089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105423a-5878-45c0-bd1b-4acd592fc445 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:25.621373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1d19d-4b8e-4b81-aa3a-5fe53138b203 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:25.698551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:25.700166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:25.700941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:25.701741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:25.706803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:25.707897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:25.708203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:25.708549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/f83b63a8c1f748209f3b8fa64982ba29/roles/461a6fd6e16d4729a46f450f9fcc4405` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:25.714987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, user_id=f83b63a8c1f748209f3b8fa64982ba29, role_id=461a6fd6e16d4729a46f450f9fcc4405)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:25.716518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:25.752476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 78/153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:25 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/users/f83b63a8c1f748209f3b8fa64982ba29/roles/461a6fd6e16d4729a46f450f9fcc4405 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:25.775226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:25.860740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:25.864357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de01d5b6-0e86-4aa2-94ce-95a625e8ff74 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:26.073019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 76/154] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:26.079287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:26.139245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb794b2-88a1-4ef6-95ee-d6f82f32d089 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:26.140683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb794b2-88a1-4ef6-95ee-d6f82f32d089 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:26.141454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb794b2-88a1-4ef6-95ee-d6f82f32d089 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:26.144493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 77/155] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:26.152168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:26.152425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:26.152720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:26.185582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:26.186973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:26.262229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:26.340109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a51e0-04d6-4c66-89c2-17a71f4a197c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:26.344658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:26.368572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 78/156] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:26.408442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:26.432272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:26.433171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:26.433454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:26.433738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:26.438928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:26.440471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:26.442396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 79/157] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:26 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:26.448594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:26.604740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64c8b2-b55e-4b3f-b644-6a4dff9a7403 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:26.675388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:26.676628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:26.677047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:26.677461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:26.703148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:26.711875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:26.712911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:26.713680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:26.718847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 79/158] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:26.725558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:26.746227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe93c9-61f5-42f1-ac92-2eef37d77e33 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:26.839494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:26.840188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:26.840473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:26.840749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:26.841630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:26.841943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:26.843553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:26.860228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 80/159] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:26 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 608 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:26.868984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:26.961268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75ee0f-8a2d-4367-ac16-76611387dffb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:27.013572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:27.014296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:27.014574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:27.014846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:27.015626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:27.015930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:27.017385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:27.031487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 80/160] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:27.037683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:27.047373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:27.203746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef6531-682f-4dfc-8d1d-60ecc90ec04c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:27.245514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:27.246389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:27.246668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:27.246942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:27.248406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:27.249969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:27.252325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 81/161] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:27 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:27.267438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:27.435747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901d9bb-db0b-42ef-915d-a44382b0ac21 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:27.461810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:27.483529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:27.484207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:27.484487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:27.484759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:27.578550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:27.580135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952190ef-bce0-45cc-80a8-ee6a8cdfdf1c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:27.723970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 81/162] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:27.730333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:27.807617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb6169-04c4-4b0a-9902-5c7d6007c293 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:27.807966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb6169-04c4-4b0a-9902-5c7d6007c293 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:27.808164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb6169-04c4-4b0a-9902-5c7d6007c293 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:27.809734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 82/163] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:27.816748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cbbd-62fa-422d-9e3c-452501f74ef5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:27.817182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cbbd-62fa-422d-9e3c-452501f74ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:27.817481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646cbbd-62fa-422d-9e3c-452501f74ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:27.844489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2646cbbd-62fa-422d-9e3c-452501f74ef5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:27.845655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2646cbbd-62fa-422d-9e3c-452501f74ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:27.859419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:27.868376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:27.926388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf56810-0785-4541-9e6a-9ca48e4f9fcd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.023418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.024361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.024644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.024922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] PATH_INFO: `/v3/projects/fe8f017cb20e47bdab5611c31e866a29` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.026898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] RBAC: Authorizing `identity:get_project(project_id=fe8f017cb20e47bdab5611c31e866a29)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:28.028443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631ed0a-4871-4ce9-8b4f-61c3b3171f21 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:28.030582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 82/164] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:27 2022] GET /identity/v3/projects/fe8f017cb20e47bdab5611c31e866a29 => generated 312 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:28.031708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58e70-9dd7-4f23-b095-0c0863d58b73 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.031955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58e70-9dd7-4f23-b095-0c0863d58b73 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.032330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db58e70-9dd7-4f23-b095-0c0863d58b73 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.033667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 83/165] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:28.039096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db58e70-9dd7-4f23-b095-0c0863d58b73 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.040557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 83/166] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:28.047623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.047910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.048181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.082085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:28.083821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:28.215979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db58e70-9dd7-4f23-b095-0c0863d58b73 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.281538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.282342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.282627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.282905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.283768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=fe8f017cb20e47bdab5611c31e866a29, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:28.284085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:28.285589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:28.295020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 84/167] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=fe8f017cb20e47bdab5611c31e866a29&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 608 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:28.295651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.304314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:28.340350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 84/168] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:28.385309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.472413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2286b-fb7d-430a-84dc-ff29ca1a4ad6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.534741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.535665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.537602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.537883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.555336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:28.556032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:28.569066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:28.570267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:28.571058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 85/169] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:28.578880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.602543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57e95a-7004-4909-a07a-e42ce3041ba2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.657451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.658303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.658586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.658862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.676035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:28.693199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:28.694214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:28.695096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 85/170] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:28.700528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:28.703344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.748564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c3b09-e29d-438d-b977-ba91a212451e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.803565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.804261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.804548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.804823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.805595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:28.805905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:28.807911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:28.821062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 86/171] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:28.827191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:28.898018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39586b-afff-423c-adfd-3438a4d8d453 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:28.981145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:28.982414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:28.982908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:28.983399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:28.984386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:28.984901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:28.986575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:28.998432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.007039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 86/172] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:29.014730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:29.060181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582c695-ef30-41ce-9baf-6492f09335e5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:29.126069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.146302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:29.147438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.147727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.147982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] PATH_INFO: `/v3/users/62b75aba48374a829d632b243d81c776` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.151399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] RBAC: Authorizing `identity:get_user(user_id=62b75aba48374a829d632b243d81c776)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:29.153080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:29.155050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 87/173] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:28 2022] GET /identity/v3/users/62b75aba48374a829d632b243d81c776 => generated 275 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:29.162414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:29.268205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb3be9-5309-4787-a922-09dedb196791 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:29.365698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:29.366645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.366930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.367402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] PATH_INFO: `/v3/users/b6ff555140924a9182c287c0588e7e67` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.368971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] RBAC: Authorizing `identity:get_user(user_id=b6ff555140924a9182c287c0588e7e67)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:29.371370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b80ff-5813-4c46-a381-d54e93018a9c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:29.373375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 87/174] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:29 2022] GET /identity/v3/users/b6ff555140924a9182c287c0588e7e67 => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:29.373955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb94e15e-8b75-480c-ac2f-a8e1ce80cc50 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:29.374702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bada-2520-49d7-8698-a87f16fea3d4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.374991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bada-2520-49d7-8698-a87f16fea3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.375317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af13bada-2520-49d7-8698-a87f16fea3d4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.382077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 88/175] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:29.382077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13bada-2520-49d7-8698-a87f16fea3d4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:29.447726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:29.449221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.449902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.450432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.464509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.544765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af13bada-2520-49d7-8698-a87f16fea3d4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:29.562422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.573387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:29.575290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe4dda-3538-40ff-b056-c0bfcdd1c2d6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:29.586435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:29.587208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.587526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.587808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.686389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 88/176] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 10:21:29.688074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c8d-68a5-429d-ab2b-67e8bae792f7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.688355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c8d-68a5-429d-ab2b-67e8bae792f7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.688761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f74c8d-68a5-429d-ab2b-67e8bae792f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.700653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:29.702325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a8b303-353d-4e9e-9363-a71d38489846 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:29.706650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-00f74c8d-68a5-429d-ab2b-67e8bae792f7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:29.707961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-00f74c8d-68a5-429d-ab2b-67e8bae792f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:29.781238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.801966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 89/177] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:29.808260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e1bb-068f-486d-8d73-58355af84bcc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.808895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e1bb-068f-486d-8d73-58355af84bcc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.809377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1602e1bb-068f-486d-8d73-58355af84bcc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.811837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 90/178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:29.812994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7794db-27e1-46d0-984e-049c15bffcbf None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.813260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7794db-27e1-46d0-984e-049c15bffcbf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.813537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7794db-27e1-46d0-984e-049c15bffcbf None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.819008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 91/179] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:29.819008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7794db-27e1-46d0-984e-049c15bffcbf None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:29.836874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 89/180] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:29.838529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567d92-982e-4083-ada0-beeca600a6fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.838954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567d92-982e-4083-ada0-beeca600a6fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.839417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60567d92-982e-4083-ada0-beeca600a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.846740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:29.860013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-60567d92-982e-4083-ada0-beeca600a6fe None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:29.861451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-60567d92-982e-4083-ada0-beeca600a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:29.934831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7794db-27e1-46d0-984e-049c15bffcbf None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:29.966098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 90/181] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:29.967284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.967804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.968294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.986372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:29.987744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:29.989098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:29.989646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:29.991300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:29.992843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:29.994794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 92/182] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:29 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:29.995449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:29.998124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:30.000711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:30.090482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 91/183] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:30.092485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.104358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.117636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240d725-10e4-4874-bdc2-e787c766ae7d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.129614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.171671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.173070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.173557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.174081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.176168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.179087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.182199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 93/184] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:30.183725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.210395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fdf302-91f6-412f-8536-11612b4bbdf5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.262260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.263240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.263530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.263808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.265044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.266597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.268371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 92/185] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:30.269146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.314105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72f9a-e857-4d47-b592-48e959261028 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.354838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.355879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.356253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.356625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.369404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:30.377802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:30.378984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 94/186] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:30.381849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.388443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.396581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10368a-c83c-4417-a643-a010badc439f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.404759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.432870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59946e7d-281e-4298-a375-51178db58cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.433555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946e7d-281e-4298-a375-51178db58cca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.433830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946e7d-281e-4298-a375-51178db58cca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.434131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59946e7d-281e-4298-a375-51178db58cca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.434978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59946e7d-281e-4298-a375-51178db58cca None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=62b75aba48374a829d632b243d81c776) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:30.435287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59946e7d-281e-4298-a375-51178db58cca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.436780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59946e7d-281e-4298-a375-51178db58cca None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.443962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 93/187] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/role_assignments?user.id=62b75aba48374a829d632b243d81c776&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:30.445060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b5c9a-0fa4-4a3d-9be6-852d77affa0c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.445342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b5c9a-0fa4-4a3d-9be6-852d77affa0c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.445615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b5c9a-0fa4-4a3d-9be6-852d77affa0c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.446894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 94/188] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:30.447578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b5c9a-0fa4-4a3d-9be6-852d77affa0c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.521479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df5b7-832a-4846-b384-1b5b5e0f98a7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.580117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.581251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.581704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.582187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.600349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:30.615145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:30.616067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:30.616924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:30.617531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 95/189] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:30.620189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.626433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b5c9a-0fa4-4a3d-9be6-852d77affa0c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.672720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.673423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.673702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.673984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.674795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.676409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.700915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 95/190] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:30 2022] POST /identity/v3/users => generated 297 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:30.701627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.737158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.761852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:30.789434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9a57b-abf4-45e7-a090-06cd3d8a2d87 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.836575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.838776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.839498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.840229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.842441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=b6ff555140924a9182c287c0588e7e67) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:30.843219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.846380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82fc5dc-51e3-478c-ac64-81bc56680464 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.857976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 96/191] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/role_assignments?user.id=b6ff555140924a9182c287c0588e7e67&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:30.866388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.866388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.866388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.885612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:30.887211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:30.889271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c099ee6-57e3-42c5-9850-14fc2c101f15 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:30.970549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:30.971464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:30.972863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:30.973424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:30.974550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:30.974784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:30.976387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:30.988241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 96/192] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:30.989334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:30.999752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 97/193] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:31.002028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.134589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:31.136206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:31.166423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315dfc65-9c3b-4d1c-a73a-630b7b73b8fc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.174113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5406e-3646-4952-9b26-75df12881f31 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.225305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.227020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.227317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.227587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] PATH_INFO: `/v3/users/f83b63a8c1f748209f3b8fa64982ba29` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.229284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] RBAC: Authorizing `identity:get_user(user_id=f83b63a8c1f748209f3b8fa64982ba29)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:31.230839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:31.232863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 98/194] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/users/f83b63a8c1f748209f3b8fa64982ba29 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:31.233367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.239434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.240430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.240751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.241334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.241894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:31.242311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:31.245077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:31.260427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 97/195] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:31.263537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.345597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f63aa-bc42-4410-b21d-6c5989c2b39a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.384341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.385249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.385490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.385724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.399325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:31.408636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:31.412751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 99/196] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:31.423492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.425605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:31.475129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ba75c4-81b9-45d0-ab58-3ceff3cf87cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.533996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555260-a1b4-40d1-afcb-aad22eb39857 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.544470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.545686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.546244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.546819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.564298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:31.572721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.573638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.573967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.574295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.590593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:31.592214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:31.594095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 100/197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:31.594903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.664275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:31.687080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:31.690544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:31.715644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fab1fb-cbca-49d3-8e8d-c7bbe034ccbf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:31.777705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:31.779004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:31.779565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:31.780447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:31.781933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:31.783209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:31.786229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:31.809502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 101/198] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:31.809502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.906097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 98/199] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:31.906097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:31.975951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.004834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b2fd5-2026-49fb-b7dc-121fc035c87f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.045852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.066368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.068036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.068728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.069407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.084669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb8e90-aac0-4f34-86c7-0daa71084910 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.144035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.145538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.146010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.146632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.148710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:32.151332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:32.154410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 99/200] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:32.163300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:32.195373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:32.199021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:32.352174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dfac7b-b33f-4bde-b740-f347d7ae3564 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.370032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.399821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 102/201] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 595 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:32.401349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:32.420924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.422905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.423550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.424240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.426566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:32.429441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:32.433255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 100/202] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:32 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:32.435044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:32.449389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.572243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd554af2-620a-48fb-a094-05c454f03e29 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.628839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.630561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.631269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.631836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.641864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423932fa-7496-4c41-8615-9f292cd380c9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.710185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.711736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.712275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.713095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.715652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:32.718378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:32.722247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 101/203] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:32 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:32.724539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:32.747378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:32.750562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:32.794725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.820392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:32.931110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e098c-a39b-47fc-8367-0bd15b81d76a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:32.940687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 103/204] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:32.946386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:32.995778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:32.997276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:32.998280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:32.998793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:32.999927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68, user.id=f83b63a8c1f748209f3b8fa64982ba29) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:33.000493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:33.002344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:33.009620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 102/205] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:32 2022] GET /identity/v3/role_assignments?user.id=f83b63a8c1f748209f3b8fa64982ba29&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:33.010965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.172947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b94239-56e7-45e7-8e4e-162fa81879fb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:33.183134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:33.213152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70abcf79-9e4b-419f-af6b-e0e37671427f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:33.216655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:33.217911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.218437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.218928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.220566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:33.222434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:33.224635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 103/206] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:33 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:33.241647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.276238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:33.317119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:33.318636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.319275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.319905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.321551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=24e884f5a9cf41a9b2b3fe7665862901) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:33.324155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:33.327175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53f47c6-0279-4288-90f7-ff6dc75d99aa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:33.344493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 104/207] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:32 2022] GET /identity/v3/role_assignments?user.id=24e884f5a9cf41a9b2b3fe7665862901&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:33.429406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a799c6-4879-4362-b57d-a1f5ca4d6043 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.430797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a799c6-4879-4362-b57d-a1f5ca4d6043 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.431324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a799c6-4879-4362-b57d-a1f5ca4d6043 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.434698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 105/208] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:33.443301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.443628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.444012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.486036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef81ae78-9738-4f1e-8816-a476d11bf919 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:33.489317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:33.490832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:33.558346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:33.559192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.559609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.560031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.561091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=24e884f5a9cf41a9b2b3fe7665862901) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:33.561531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:33.563317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f26e04-5957-4cf9-a55d-516df6d03fbf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:33.571145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 104/209] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:33 2022] GET /identity/v3/role_assignments?user.id=24e884f5a9cf41a9b2b3fe7665862901&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:33.579574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e245-5e96-4aba-840c-2d1f8ea0b054 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.579998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e245-5e96-4aba-840c-2d1f8ea0b054 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.580141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b31e245-5e96-4aba-840c-2d1f8ea0b054 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.581840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 105/210] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:33.587784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.594246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 106/211] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:33.594479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.594479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.613509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:33.615723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:33.633293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.655347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:33.702563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 106/212] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:33.726373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.820621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4b05e-353f-4745-bb7c-97c9247192a6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:33.839781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:33.852355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197824f5-c197-4b2a-b059-61be44da4b14 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:33.875351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:33.878026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.878850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.879781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.883638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:33.886785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:33.889162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 107/213] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:33.897940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.903737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:33.905229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:33.905903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:33.906594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:33.932690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:33.940905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:33.942905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:33.944216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 107/214] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:33.949066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:33.985014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:34.073786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815405d-ebbb-4b6a-a1ec-9e6f8e615abe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:34.075995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bca48b-aea4-40c7-ba43-8a9d7ea2eb22 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:34.116002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:34.116699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:34.116984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:34.117265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:34.118037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:34.118448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:34.119821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:34.128702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:34.129426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:34.129763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:34.130200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:34.130945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:34.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:34.137805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 108/215] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:34.139004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:34.170084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 108/216] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:33 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:21:34.264601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:34.278339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4292cd5f-bcdb-42e7-8792-e3939541c44a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:34.321861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:34.323273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:34.323761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:34.324235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] PATH_INFO: `/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:34.342128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] RBAC: Authorizing `identity:get_user(user_id=253ff7ecd96e4f92ace0b7ae3cf7ca79)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:34.344148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:34.346380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 109/217] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:34 2022] GET /identity/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79 => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:34.358120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:34.425343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:34.499100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d8522-4c17-4fd7-bf6e-781316fefff7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:34.538736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:34.539375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:34.539659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:34.539939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:34.616802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:34.618449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:34.669398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:34.746304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 109/218] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:34.752161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:34.899443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469683b5-1179-411c-aff8-483ad3329e93 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:34.949691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:34.950990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:34.951514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:34.951989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:34.953404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:34.955138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cae308a-3fcd-4d67-bb68-58f53961214d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:34.957406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 110/219] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:34 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:34.963263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:35.120640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689c16d-317f-48d8-8f78-9ffdf766b4de None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:35.161922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:35.162556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:35.162836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:35.163128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:35.163993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=253ff7ecd96e4f92ace0b7ae3cf7ca79) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:35.164308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:35.165813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd460691-0b42-40a5-9807-46702f5d660e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:35.172957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 110/220] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:34 2022] GET /identity/v3/role_assignments?user.id=253ff7ecd96e4f92ace0b7ae3cf7ca79&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:35.974583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fb8f-1996-44bc-919a-7433b4717675 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:35.975643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fb8f-1996-44bc-919a-7433b4717675 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:35.976159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7fb8f-1996-44bc-919a-7433b4717675 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:35.977819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 111/221] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:35.984010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:35.984905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:35.985404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:35.989220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebb2e-328c-4b05-b75d-5b54fedbd10a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:35.990938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebb2e-328c-4b05-b75d-5b54fedbd10a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:35.992616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccebb2e-328c-4b05-b75d-5b54fedbd10a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:35.995894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 112/222] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:35.997904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.002380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.003174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.005660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.021788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:36.023054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:36.032445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:36.034038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:36.058468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.104984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 111/223] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:36.143755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 113/224] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:36.156486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.181368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.361680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01c6c6-4558-4fc9-ad6b-7ab20f79f61b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.376059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da59d02b-4522-4142-a05b-978cffe944d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.429693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:36.430565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.430839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.431274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.434417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.443818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:36.444143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:36.444977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.445260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.445595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:36.452750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:36.453709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:36.454519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 112/225] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:36.464698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.470580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:36.488218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:36.490501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:36.492141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:36.499786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.516155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.681390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3695d56b-e974-43fa-b6bc-94eea5f665de None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.720004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a70635-6f3c-4d25-aaa2-8f01b212a67f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.720952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:36.722026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.722345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.722632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.724102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:36.724476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:36.725921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:36.737219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:36.743193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.793931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:36.794859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.795144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.795418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.796187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:36.796500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:36.798040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:36.807818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 115/228] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:36.818092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:36.867779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.898415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:36.939069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abc414e-2716-4fdd-be09-369e4561c329 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.970333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bab8f-6752-4336-9ee2-e0b1404238bd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:36.980792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:36.982437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:36.982906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:36.983361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:36.984863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:36.986571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:36.988936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 116/229] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:36.999322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.059751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.060663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.060942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.061215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.065670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.067414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.069343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 114/230] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:37.075020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.131440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffce47-15eb-4cf7-89f7-7f8b65d17769 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:37.185390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.186709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.187300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.187765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.189297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.191105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.193923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 117/231] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:36 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:37.198156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be47377-83fb-47e9-ab83-9587a4ec73a9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:37.199333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.204930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:37.246242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:37.262585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.263506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.263790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.264067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.265427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.269118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b51d85-2e86-4016-9d10-2b2dac1b98c5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.269118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 115/232] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:37 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:37.275023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b959-4d14-46a3-b999-e385b97fa693 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.275259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b959-4d14-46a3-b999-e385b97fa693 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.275538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68b959-4d14-46a3-b999-e385b97fa693 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.277162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 116/233] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:37.278674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68b959-4d14-46a3-b999-e385b97fa693 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.345135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746b8af0-e50a-4da2-95bf-b218e34cacfe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:37.387848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.388756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.389036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.389308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/24e884f5a9cf41a9b2b3fe7665862901/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.391335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, user_id=24e884f5a9cf41a9b2b3fe7665862901, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.392817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05209677-7194-42cb-b2e8-b27e2ee09605 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.418091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 118/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:37 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/24e884f5a9cf41a9b2b3fe7665862901/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:37.418091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.418091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.418091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.427156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68b959-4d14-46a3-b999-e385b97fa693 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:37.440507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:37.442728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:37.474568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.475664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.475938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.476208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/24e884f5a9cf41a9b2b3fe7665862901/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.479420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, user_id=24e884f5a9cf41a9b2b3fe7665862901, role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.481089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1313296-620d-4fe0-be10-bb6b94352f9b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.501592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 117/235] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:37 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/24e884f5a9cf41a9b2b3fe7665862901/roles/bacfbe396cb341d7a82bead66b616b8f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:21:37.503518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c919-7bc9-431b-9cf0-16047affdd2b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.503827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c919-7bc9-431b-9cf0-16047affdd2b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.504125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6c919-7bc9-431b-9cf0-16047affdd2b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.507169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 118/236] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:37.513012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0909-69fa-47ca-8c36-016aadaf8232 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.513325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0909-69fa-47ca-8c36-016aadaf8232 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.513574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe0909-69fa-47ca-8c36-016aadaf8232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.531265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:37.537538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-20fe0909-69fa-47ca-8c36-016aadaf8232 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:37.539249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-20fe0909-69fa-47ca-8c36-016aadaf8232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:37.544627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 119/237] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:37.574715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.649750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:37.690810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 119/238] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:37.692711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729416-eb38-4875-994f-953b14fdf053 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.693169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729416-eb38-4875-994f-953b14fdf053 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.693418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06729416-eb38-4875-994f-953b14fdf053 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.695638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 120/239] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:37.701021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.701336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.722381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:37.723902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:37.767254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0d3edb-9c4a-45a2-b5ce-d74d7957a908 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:37.822001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:37.822851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:37.823169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:37.823452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:37.824743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:37.826385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:37.828154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 120/240] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:37.828950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.835570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 121/241] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:37.836931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:37.975973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:37.997818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473471a-5c72-4856-bcdb-a2173f13f5b9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.015558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:38.048490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.049680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.050168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.050601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.052122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.054191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.066327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e6af8-18c9-4159-8bbf-8e6b088ae291 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.088842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 122/242] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:37 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:38.091695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.114169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.115132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.115427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.115689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.129067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:38.137216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:38.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:38.140130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:38.141861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 121/243] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:38.147808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.243854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f97cdd2-c4b4-4d16-851f-2a3701d74183 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.273355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9cc10a-71ad-4403-b6d8-ba51d5177004 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.287719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.288921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.289424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.289893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.301863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:38.302604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:38.310989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:38.311946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:38.312740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:38.315843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 123/244] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:38.322155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.322155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.322155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.322155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.322543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:38.322543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.322660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.323983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.349062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 122/245] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:38.355754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.359247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:38.446825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee203b-dfdc-4c77-9710-6a269c0f4eba None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.524451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.525460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.525926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.526458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.527935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:38.528464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.531148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.533074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72eef3-1c94-4818-b7e1-04e16ec80ff7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.549529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 124/246] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:38.559842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.581147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.582400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.582915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.583646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] PATH_INFO: `/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.599797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] RBAC: Authorizing `identity:get_user(user_id=97312c864fd44e3fbb8aadaf8e7e5e0a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.601594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.603999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 123/247] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:38.613573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.722476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:38.726223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:38.743904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2314f253-e77f-41dd-9dc5-76add31dbbfd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.804665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aac0643-ac80-48fc-85da-0f541bc7aa92 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:38.808387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.809794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.810425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.811017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] PATH_INFO: `/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.813294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] RBAC: Authorizing `identity:get_user(user_id=253ff7ecd96e4f92ace0b7ae3cf7ca79)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.816347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.821890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 125/248] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:38.829068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:38.845959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:38.846908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:38.847354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:38.847763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:38.929301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:38.932088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:38.980886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:39.025344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57183df0-871c-427e-aaa7-70123c1de1a1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:39.056062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 124/249] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:39.061404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:39.093863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:39.096463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:39.097395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:39.097994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:39.101656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:39.106632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:39.110640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 126/250] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:38 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:39.121954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:39.183837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:39.243562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d071c-3b8c-40a0-a1e4-3c82b98c03d5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:39.327245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:39.328971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:39.329571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:39.330161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:39.335551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:39.338506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:39.346240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 125/251] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:39 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:39.348878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:39.364013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2958d4b-e982-4fe8-9594-af7c2cc5426d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:39.384107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:39.430009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:39.432288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:39.433100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:39.433880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/253ff7ecd96e4f92ace0b7ae3cf7ca79/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:39.445149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, user_id=253ff7ecd96e4f92ace0b7ae3cf7ca79, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:39.450030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989c9bd-eaf3-40dc-9291-12f74d336005 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:39.518163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 127/252] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:39 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/253ff7ecd96e4f92ace0b7ae3cf7ca79/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:21:39.644797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffd32a-8235-4d36-9093-2bb0cfe841c0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:39.735357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:39.736504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:39.736997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:39.737489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:39.739179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=97312c864fd44e3fbb8aadaf8e7e5e0a) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:39.739751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:39.742739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f3866-5db9-4dee-a70b-29d41fe07bac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:39.754237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 126/253] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:39 2022] GET /identity/v3/role_assignments?user.id=97312c864fd44e3fbb8aadaf8e7e5e0a&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 259 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:40.654825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de094-7b86-48f4-8359-b039ac28def7 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:40.655372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de094-7b86-48f4-8359-b039ac28def7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:40.655784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53de094-7b86-48f4-8359-b039ac28def7 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:40.658519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 128/254] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:40.666074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:40.666633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:40.667039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:40.703932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:40.705941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:40.871177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 127/255] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:40.902303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de094-7b86-48f4-8359-b039ac28def7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:41.013295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:41.030195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53de094-7b86-48f4-8359-b039ac28def7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:41.070470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:41.071274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:41.071554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:41.071844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:41.083896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e0ce08b9-fdfd-4e02-ac79-8cfde618351b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:41.092320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:41.093519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:41.094356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 129/256] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:41.104193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:41.116750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:41.284335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaa3c7-87d3-4aa0-9712-ceee0609dbbc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:41.285021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaa3c7-87d3-4aa0-9712-ceee0609dbbc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:41.285485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daaa3c7-87d3-4aa0-9712-ceee0609dbbc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:41.287821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 130/257] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:41.312178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:41.312791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:41.313363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:41.351607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:41.353249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:41.456064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94440a72-06a9-46f2-9c1f-d53a56b4adee None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:41.497284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 131/258] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:41.602203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:41.603209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:41.604007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:41.604440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:41.605657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:41.606201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:41.608791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:41.619177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:41.650503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 128/259] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:41.655924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:41.770085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:41.848263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2dfb6-e465-4b50-9b18-e172aae455a8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:41.925621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:42.026835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:42.036032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.037034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.038725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.039532 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc35a0-fa60-4b64-ab49-51f2a2c906da None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:42.096503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:42.116078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:42.116973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.117254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.117531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.118783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:42.120256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:42.121520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:42.122452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:42.123235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:42.123906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 129/260] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:41 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:42.129627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:42.132369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 132/261] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 514 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:42.138832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:42.289937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205579b-c6d8-43e5-af39-55474f081a76 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:42.352263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:42.352935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.353222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.353868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.358360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:42.475283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:42.476811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8188c502-737c-4d37-8311-d31fa92c0176 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:42.566622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457d9d24-8219-477f-a9f8-a615d621296d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:42.637325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:42.638016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.638325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.638600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.639360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:42.639671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:42.641104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bd419b-f63b-4061-a25e-9e7894959b37 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:42.649218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:42.663649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 133/262] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:42.665050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1625-126a-43f8-acc9-6f031c632ba4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.665336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1625-126a-43f8-acc9-6f031c632ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.665613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb1625-126a-43f8-acc9-6f031c632ba4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.667051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 134/263] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:42.674779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb1625-126a-43f8-acc9-6f031c632ba4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:42.685976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 130/264] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:42.691341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.691631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.691953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.731110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:42.732330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:42.796786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb1625-126a-43f8-acc9-6f031c632ba4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:42.815110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:42.834367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:42.835203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:42.835482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:42.835755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] PATH_INFO: `/v3/users/24e884f5a9cf41a9b2b3fe7665862901` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:42.837079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] RBAC: Authorizing `identity:get_user(user_id=24e884f5a9cf41a9b2b3fe7665862901)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:42.838739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:42.846545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 135/265] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:42 2022] GET /identity/v3/users/24e884f5a9cf41a9b2b3fe7665862901 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:42.847620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:42.885099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 131/266] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:42.886598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:42.939557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:42.980169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd834-f980-4bf2-8e00-206618d3d56f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.006909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43fae51-1c5a-4b84-a7fb-c921ae87272f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.017781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.018900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.019093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.019418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.020748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.022474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734e0b5-56b7-412a-8034-91bc3005a247 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.024305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 136/267] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:42 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.025653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173338c4-f8b5-49b3-b1d2-744e7d9c3f87 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.025938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173338c4-f8b5-49b3-b1d2-744e7d9c3f87 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.026253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173338c4-f8b5-49b3-b1d2-744e7d9c3f87 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.027519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 137/268] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:43.028241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173338c4-f8b5-49b3-b1d2-744e7d9c3f87 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.048901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.049946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.050459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.050939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.087798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.132579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.134304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.140068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173338c4-f8b5-49b3-b1d2-744e7d9c3f87 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.179250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.180415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.180941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.181378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.183809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.197403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e8d437d7-8aa3-4f8f-8d54-b6be1f880c7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:43.208548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:43.209532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:43.210383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:43.211799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 138/269] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:43.215424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8ffe-8493-421e-ad89-3dd7d691e2a2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.215777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8ffe-8493-421e-ad89-3dd7d691e2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.216123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc8ffe-8493-421e-ad89-3dd7d691e2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.235608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-94fc8ffe-8493-421e-ad89-3dd7d691e2a2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:43.236809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-94fc8ffe-8493-421e-ad89-3dd7d691e2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:43.248830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 132/270] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:43.248830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.316211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.323843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 139/271] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:43.332204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8622c0-3eea-43e5-80d5-f97656f29d4b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.333264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8622c0-3eea-43e5-80d5-f97656f29d4b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.333764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8622c0-3eea-43e5-80d5-f97656f29d4b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.336077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 140/272] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:43.336967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8622c0-3eea-43e5-80d5-f97656f29d4b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.362459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df21b55a-0b2f-4eb6-938e-12297cc03d81 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.398470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.399129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.399430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.399705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.400552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=24e884f5a9cf41a9b2b3fe7665862901) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:43.400863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.402345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.409073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 133/273] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/role_assignments?user.id=24e884f5a9cf41a9b2b3fe7665862901&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.409726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.502939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8622c0-3eea-43e5-80d5-f97656f29d4b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.533635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.546814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.547501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.547940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.548351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.549326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:43.549851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.551694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabd3566-22c5-4fe7-b545-46710b518be7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.557612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9d0ea-c04b-42bb-b611-558818f7d724 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.566810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 141/274] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.568627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.569116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.569532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.588061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:43.589287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:43.592073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.603900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.604792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.605072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.605340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.606625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.608092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.609839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 134/275] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.610657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.676173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 142/276] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:43.679603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.731205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367ac6d-e3c8-4758-a7ec-23e2a6ed50b3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.765484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.766312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.766597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.766869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.768071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.769557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d0853-5ea2-4082-b005-7818cd38bc0a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.771291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 135/277] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.772600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a17b4-54df-498a-a731-30a3d4bef01c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.772889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a17b4-54df-498a-a731-30a3d4bef01c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.773167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a17b4-54df-498a-a731-30a3d4bef01c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.774472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 136/278] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:43.775236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a17b4-54df-498a-a731-30a3d4bef01c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.783609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7fe633-0654-42ad-8ba7-a38ae817cb9d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.803471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.824650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.825550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.825830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.826133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] PATH_INFO: `/v3/users/2ed59ab6a80f4ce894afc3293390bb8b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.841801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] RBAC: Authorizing `identity:get_user(user_id=2ed59ab6a80f4ce894afc3293390bb8b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.843328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.845551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 143/279] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/users/2ed59ab6a80f4ce894afc3293390bb8b => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.845851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:43.850020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:43.889126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a17b4-54df-498a-a731-30a3d4bef01c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:43.924737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:43.925393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.925670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.925937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.927020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=24e884f5a9cf41a9b2b3fe7665862901) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:43.927283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:43.928761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1786b278-d2d6-4d8d-bfeb-0f71a0a2db6c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:43.934983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 137/280] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/role_assignments?user.id=24e884f5a9cf41a9b2b3fe7665862901&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:43.936327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:43.936614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:43.936888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:43.962044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:43.963688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:43.963997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607790e-b5f9-49c7-92be-e89df65eae9d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.006494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.007331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.007609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.007884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.020471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:44.028444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:44.029427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:44.030966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:44.035032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 144/281] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:44.035969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.062972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 138/282] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:44.064076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.080053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.143758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.163489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9163e0b-c745-4cb2-96e0-a2943ae062b3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.195290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48de253-68fe-4793-acd3-2ec5fbdec8d1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.203357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.204050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.204329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.204601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.205343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.206913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.230177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 145/283] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:21:44 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:44.231035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.246161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.246976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.247158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.247450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.248334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, user.id=2ed59ab6a80f4ce894afc3293390bb8b, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:44.248650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.250442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.261833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 139/284] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/role_assignments?user.id=2ed59ab6a80f4ce894afc3293390bb8b&scope.system=all&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:44.262563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.351360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.367419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acaedb-415c-4836-bfef-1988b14caf3e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.410945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.412087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.412589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.413293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.414389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:44.414973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.416686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.427358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 146/285] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:44.432693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca173a-8eb3-4e31-b43d-b55f547437c0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.434556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.463355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.480976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.482084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.482084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.482992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.499835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:44.508181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:44.509132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:44.509915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 140/286] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:44.515891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.594430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e93c84-b748-44d9-96ca-af9582571fcb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.637085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.638113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.638485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.638817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] PATH_INFO: `/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.640214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] RBAC: Authorizing `identity:get_user(user_id=253ff7ecd96e4f92ace0b7ae3cf7ca79)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.641765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.645801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 147/287] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/users/253ff7ecd96e4f92ace0b7ae3cf7ca79 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:44.651154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d40fa7-5d43-4220-8a12-e10845db122e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.651414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.680391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.701775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.702508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.702792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.703069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.703837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:44.704151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.705570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.716909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 141/288] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:44.722747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.819062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:44.819744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867f1a-df27-4112-ab0c-b7ae15f70401 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.875207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.876245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.876797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.877272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.899176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02b814-342d-401b-b9b8-a4d1cf50c48f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:44.941645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:44.943234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:44.943549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:44.943826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] PATH_INFO: `/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:44.945249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] RBAC: Authorizing `identity:get_user(user_id=97312c864fd44e3fbb8aadaf8e7e5e0a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.947085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:44.949482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 142/289] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a => generated 297 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:44.959249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:44.992707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:44.994669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:45.018409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:45.107105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 148/290] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 10:21:45.119183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:45.168620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fd3ce-b20f-4208-a4cb-1708645f6625 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:45.202347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:45.242568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:45.243517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:45.243739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:45.244017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:45.251518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:45.253079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:45.255675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 143/291] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:44 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:45.261932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:45.302090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad8130-f686-4e76-a1f2-8e84c0b4d02e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:45.324431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:45.342177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:45.343066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:45.343348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:45.343622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:45.345485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:45.347013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:45.348860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 149/292] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:45 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:45.358681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:45.470445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c71473-d6a9-49e0-8a01-9fd4b72d62e5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:45.506951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc465a-2e49-46a7-92ef-84013e69e4a2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:45.508185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:45.508866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:45.509149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:45.509429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:45.510324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=253ff7ecd96e4f92ace0b7ae3cf7ca79) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:45.510639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:45.512135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14ce40-3903-4246-9df8-81ba0837512a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:45.519274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 150/293] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:45 2022] GET /identity/v3/role_assignments?user.id=253ff7ecd96e4f92ace0b7ae3cf7ca79&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:45.589128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:45.590086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:45.590388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:45.590667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/97312c864fd44e3fbb8aadaf8e7e5e0a/roles/461a6fd6e16d4729a46f450f9fcc4405` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:45.592879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, user_id=97312c864fd44e3fbb8aadaf8e7e5e0a, role_id=461a6fd6e16d4729a46f450f9fcc4405)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:45.594561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fd2415-0575-4a6b-97d1-2ff6402e5139 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:45.622786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 144/294] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:21:45 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/users/97312c864fd44e3fbb8aadaf8e7e5e0a/roles/461a6fd6e16d4729a46f450f9fcc4405 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:21:46.639198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27cac-e573-412e-88e9-f4325e835d14 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.640316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27cac-e573-412e-88e9-f4325e835d14 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.640818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27cac-e573-412e-88e9-f4325e835d14 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.642555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 151/295] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:46.648842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d43c6-1b21-444e-bb0a-fd0c34d026b2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.649813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d43c6-1b21-444e-bb0a-fd0c34d026b2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.650349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d43c6-1b21-444e-bb0a-fd0c34d026b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.668342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-353d43c6-1b21-444e-bb0a-fd0c34d026b2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:46.669888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-353d43c6-1b21-444e-bb0a-fd0c34d026b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:46.706821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:46.747342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 145/296] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:46.764402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b793b8-3662-469e-b8c0-b86423e9c64d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.764802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b793b8-3662-469e-b8c0-b86423e9c64d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.765155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b793b8-3662-469e-b8c0-b86423e9c64d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.766907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 152/297] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:46.774094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80d72-dfd2-411c-b7a3-1a8a2dddee8c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.774094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80d72-dfd2-411c-b7a3-1a8a2dddee8c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.774094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b80d72-dfd2-411c-b7a3-1a8a2dddee8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.777974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b793b8-3662-469e-b8c0-b86423e9c64d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:46.791018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-07b80d72-dfd2-411c-b7a3-1a8a2dddee8c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:46.792454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-07b80d72-dfd2-411c-b7a3-1a8a2dddee8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:46.846661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:46.885495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 146/298] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:46.899884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36519800-fb3c-496f-9044-bd400e6ad769 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.900237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36519800-fb3c-496f-9044-bd400e6ad769 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.900619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36519800-fb3c-496f-9044-bd400e6ad769 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.906307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 147/299] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:46.907770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.908153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.908529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.917363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b793b8-3662-469e-b8c0-b86423e9c64d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:46.927114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:46.928053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:46.957360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:46.958380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:46.958619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:46.958900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:46.971493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:46.980867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:46.981792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:46.983020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 153/300] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:46.986429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:46.998935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 148/301] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:46.999901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.037964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.101761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d1a69-9824-4a7b-97b5-4075d925b848 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.114091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db526398-273c-47ec-b6a7-b0164d573c8c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.117508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.139357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.140156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.140434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.140702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.152206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:47.152618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.153294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.153571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.153841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.154618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:47.154927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.156319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:47.159815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:47.160939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:47.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 154/302] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:47.162480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.175163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 149/303] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.175163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.287427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.288800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157b04f-5dbe-458a-a15b-0a2747941771 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.298928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c6bf4-c822-4fef-9a21-a8f6c70b182f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.326953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.327861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.328324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.328527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.329716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.331327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.333711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 155/304] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.339065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.339458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.340142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.340419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.340689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.341444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:47.341756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.343210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.352625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 150/305] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.353818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.393798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.457333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca6989-5ba1-4473-ace1-78a4e4a47e03 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.461177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a73239-b601-4a70-85ee-0756d5e52692 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.499149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.499830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.500108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.500379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] PATH_INFO: `/v3/groups` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.501075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.502601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.506762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.507951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.508222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.508489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] PATH_INFO: `/v3/users/2ed59ab6a80f4ce894afc3293390bb8b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.509754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] RBAC: Authorizing `identity:get_user(user_id=2ed59ab6a80f4ce894afc3293390bb8b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.511384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.513075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 156/306] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:47 2022] GET /identity/v3/users/2ed59ab6a80f4ce894afc3293390bb8b => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.518803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.525063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 151/307] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jun 21 10:21:47 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:47.526107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.557423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.656968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34dd01-4485-43c2-85d3-020078123a15 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.664612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7752c8-6390-4a19-8b9c-971a1a5c4a93 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.669050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.702660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.703655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.703938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.704324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] PATH_INFO: `/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.705076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.706250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.706677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.707140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] PATH_INFO: `/v3/system/users/2ed59ab6a80f4ce894afc3293390bb8b/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.709234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2ed59ab6a80f4ce894afc3293390bb8b, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.710901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.723810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 152/308] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jun 21 10:21:47 2022] PUT /identity/v3/system/users/2ed59ab6a80f4ce894afc3293390bb8b/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:47.725753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] RBAC: Authorizing `identity:get_user(user_id=b81c7f566f334b4a8bcefb56fe0d90bd)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.727486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab50c-b466-4739-a5be-f6a958e6f353 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.729947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 157/309] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:47 2022] GET /identity/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd => generated 293 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.735973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:47.837956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:47.864795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6052b-d508-4149-94d8-7131c9aedd8e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.865137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6052b-d508-4149-94d8-7131c9aedd8e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.865382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda6052b-d508-4149-94d8-7131c9aedd8e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.868389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 158/310] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:47.873038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.873320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.873592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.873681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46f8838-326a-4d0f-a8fd-565430d8b0c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:47.893420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:47.895149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:47.918995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:47.919207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:47.919413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:47.919603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:47.920450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, user.id=b81c7f566f334b4a8bcefb56fe0d90bd, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:47.920808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:47.922312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:47.928700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 153/311] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jun 21 10:21:47 2022] GET /identity/v3/role_assignments?user.id=b81c7f566f334b4a8bcefb56fe0d90bd&scope.system=all&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:47.990485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 159/312] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:48.014592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:48.132680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c4395-1808-41cd-b2b4-ba4286ea8012 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:48.169578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:48.170418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:48.170700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:48.171000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:48.182149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:48.190264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:48.191185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:48.192152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 154/313] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:48.198018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:48.312236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:48.319042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4511-0852-448d-9ded-386ad9acbfa6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:48.361020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:48.361736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:48.362017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:48.362320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:48.363130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:48.363440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:48.365336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:48.380391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 160/314] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:48.381902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:48.385956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:48.513450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735244-e9d9-46db-a48c-2b88e69e482b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:48.556635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:48.557899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:48.558383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:48.558838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] PATH_INFO: `/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:48.560583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] RBAC: Authorizing `identity:get_user(user_id=97312c864fd44e3fbb8aadaf8e7e5e0a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:48.562305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:48.564553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 155/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:48 2022] GET /identity/v3/users/97312c864fd44e3fbb8aadaf8e7e5e0a => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:48.570207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:48.676814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60688b23-01fc-4233-85ff-e3071586781b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:48.711488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:48.712145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:48.712425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:48.712700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:48.742568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:48.784099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:48.785784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:48.895243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 161/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:48.900926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:48.981185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:49.013446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f9af-f2c2-4f33-aff2-fdad8c799292 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:49.050649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:49.051563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.051846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.052125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.053338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:49.054861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed35b4-50e6-4922-9a43-25095c222115 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:49.056910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 156/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:48 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:49.062829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:49.123266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:49.170251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6663e7-2fc4-4f96-ace1-367587452838 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:49.208365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:49.209183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.209463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.209739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.210610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, scope.project.id=a048bcfd9df2467287b5c8be01f262f0, user.id=97312c864fd44e3fbb8aadaf8e7e5e0a) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:49.210923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:49.212386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28023206-e7b9-426e-8e61-18a8e7a4a322 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:49.218862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 162/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:21:49 2022] GET /identity/v3/role_assignments?user.id=97312c864fd44e3fbb8aadaf8e7e5e0a&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:49.842436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb08d6-9415-4be5-b28c-57acf943e491 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.842882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb08d6-9415-4be5-b28c-57acf943e491 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.843233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb08d6-9415-4be5-b28c-57acf943e491 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.845460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 157/319] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:49.853714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.854273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.854527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.879315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:49.881081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:49.882650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86a0-fd85-4708-801c-6815ff29ac0f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.882911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86a0-fd85-4708-801c-6815ff29ac0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.883290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f86a0-fd85-4708-801c-6815ff29ac0f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.886101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 158/320] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:21:49.890660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:49.890910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:49.891207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:49.908001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:49.909176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:49.969078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 163/321] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:49.999499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 159/322] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:50.006133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.023559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.083998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.104002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.141362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3a930b-0f79-43f3-966b-09b760d805c6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.145661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089039d-90f6-4681-95f4-d366ca887f70 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.179952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.181340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.181851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.182366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.183985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.184386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.184781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.185055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.185321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.187141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066514f-73a3-4c80-8e37-7a3d90635e21 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.194774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 164/323] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:50.194774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965092d9-8ce0-45e7-b8ba-526f884fbd6f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.194774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965092d9-8ce0-45e7-b8ba-526f884fbd6f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.194774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965092d9-8ce0-45e7-b8ba-526f884fbd6f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.196314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 165/324] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:50.197614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965092d9-8ce0-45e7-b8ba-526f884fbd6f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.203499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-288d9677-0291-4e65-b8e4-2c69dd4de34d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:50.211969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:50.213075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:50.214040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 160/325] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:50.215388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.215674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.215946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.236836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:50.238071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:50.335775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965092d9-8ce0-45e7-b8ba-526f884fbd6f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.350087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 161/326] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:50.350087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.361248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.377526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.378286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.378568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.378923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] PATH_INFO: `/v3/groups` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.379769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.381576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.422093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 166/327] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jun 21 10:21:50 2022] POST /identity/v3/groups => generated 226 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:21:50.422093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.424228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.471315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414aa41-1403-44e3-ab8f-6aa581829cd2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.514334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.515028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.515306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.515573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.516343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:50.516649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.518124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.528222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 162/328] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:50.533800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.535217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc008abb-6490-40b1-8e0e-f07111ef01c6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.575949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.576768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.577046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.577319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.590685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:50.599872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:50.600893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:50.601703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 167/329] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:50.610212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.674366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.685054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cf902-08cc-4fe3-89b4-03d28dac1fe0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.712329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:50.737325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.739800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.739800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.739800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] PATH_INFO: `/v3/users/2ed59ab6a80f4ce894afc3293390bb8b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.740804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] RBAC: Authorizing `identity:get_user(user_id=2ed59ab6a80f4ce894afc3293390bb8b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.741981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.743911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 163/330] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/users/2ed59ab6a80f4ce894afc3293390bb8b => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:50.750634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.779352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0eb2-d989-460e-8076-ac0efe2bb96f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.825628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.826343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.826626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.826901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.827667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:50.827986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.829429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.841082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 168/331] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:50.846403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:50.913229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efb82f-3ccd-4045-b054-9bd317792b43 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.965044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:50.965044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:50.965309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:50.965537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:50.966369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] RBAC: Adding query filter params (role.id=4ccbd5b0e5ba4d53aee626148246e880, user.id=2ed59ab6a80f4ce894afc3293390bb8b, scope.system=all) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:50.966751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:50.968446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:50.985755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 164/332] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/role_assignments?user.id=2ed59ab6a80f4ce894afc3293390bb8b&scope.system=all&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 510 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:50.992690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414989b-2d69-4c14-b950-8762945dc0ae None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:50.995701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:51.053472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:51.054763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:51.055259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:51.055671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] PATH_INFO: `/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:51.057228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] RBAC: Authorizing `identity:get_user(user_id=b81c7f566f334b4a8bcefb56fe0d90bd)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:51.059156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072cfff1-a8fe-49bc-acf0-6b91d14f8a97 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:51.061236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 169/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:50 2022] GET /identity/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:51.067830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:51.146948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:51.236302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f03dc60-a3ed-4af3-af9d-5cd35390f958 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:51.290666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:51.293034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:51.293034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:51.293034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] PATH_INFO: `/v3/system/users/b81c7f566f334b4a8bcefb56fe0d90bd/roles/461a6fd6e16d4729a46f450f9fcc4405` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:51.293776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b81c7f566f334b4a8bcefb56fe0d90bd, role_id=461a6fd6e16d4729a46f450f9fcc4405)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:51.295263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac495b61-5730-43f2-b9c7-f2e4e4b2732f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:51.310094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 165/334] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jun 21 10:21:51 2022] PUT /identity/v3/system/users/b81c7f566f334b4a8bcefb56fe0d90bd/roles/461a6fd6e16d4729a46f450f9fcc4405 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:21:53.194250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a35-d028-4517-abee-77bb5d8c2b47 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.194977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a35-d028-4517-abee-77bb5d8c2b47 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.195160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81192a35-d028-4517-abee-77bb5d8c2b47 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.196974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 170/335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:53.204866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60cc-8356-40e7-84aa-c7d2c1af9862 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.205531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60cc-8356-40e7-84aa-c7d2c1af9862 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.205615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ef60cc-8356-40e7-84aa-c7d2c1af9862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.242194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-85ef60cc-8356-40e7-84aa-c7d2c1af9862 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:53.244255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85ef60cc-8356-40e7-84aa-c7d2c1af9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:53.369801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74d52-452b-4496-822e-3e27b1ea2cc9 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.370902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74d52-452b-4496-822e-3e27b1ea2cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.371840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c74d52-452b-4496-822e-3e27b1ea2cc9 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.374019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 166/337] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:53.374265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 171/337] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:53.392750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.393094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.393311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.408319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c74d52-452b-4496-822e-3e27b1ea2cc9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:53.429682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:53.430999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:53.536381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:53.625884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 167/338] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:53.651926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c74d52-452b-4496-822e-3e27b1ea2cc9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:53.681363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:53.704078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:53.704907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.705189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.705463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.723598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:53.737515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:53.738628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:53.739425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:53.740041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 172/339] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:53.746420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:53.811734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:53.879913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96062fde-5d60-4ffa-928f-e2e424db5ca8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:53.930098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d20b26-0373-4578-b268-d83c65843419 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:53.954084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:53.954908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.955190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.955463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.980208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-643cbbf5-d820-4392-b797-4bc8d7933371 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:53.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:53.990301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:53.992200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 168/340] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:53.996978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e58b1-b138-42b7-8215-4844defdf3f1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:53.996978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e58b1-b138-42b7-8215-4844defdf3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:53.996978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e58b1-b138-42b7-8215-4844defdf3f1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:53.998359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 169/341] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:54.003703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e58b1-b138-42b7-8215-4844defdf3f1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:54.008275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.010013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.010329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.010612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.011397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:54.011707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:54.013144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d5374-8747-49fd-953a-4f994256d184 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:54.027325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 173/342] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:54.033566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.033948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.034270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.059133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:54.060359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:54.061043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.153998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e58b1-b138-42b7-8215-4844defdf3f1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:54.208260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 174/343] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:54.209323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:54.235732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.236423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.236708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.236987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.237764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:54.242109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:54.243687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:54.248204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.268826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 170/344] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:54.274475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:54.420819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.436874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99b1f-c4b4-4d98-ba63-03f7781f3153 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:54.441459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1965275c-a51e-4bc0-a481-215ffe880cb3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:54.491503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.492345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.492619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.492890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.516712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:54.517710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.518407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.518684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.518957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:54.532729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:54.533728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:54.534587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:54.538463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 171/345] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:54.539429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:54.604530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:54.606041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:54.635776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.741718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0154f-2a3c-400b-95f3-d82c72c487f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:54.766029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 175/346] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:54.767264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:54.818236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.819497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.819995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.820816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.873961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.883911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea52686-ae0c-4c3b-a954-29472488dddb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:54.933412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:54.947904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:54.949751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:54.965841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:54.967003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.967284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.967562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.968862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:54.969169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:54.970977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7ff65-be64-4159-8ca9-e776c9a553b5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:54.988072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 176/347] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:54.994525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d71ac-4cc3-453d-9d91-1e438a63b2aa None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:54.995328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d71ac-4cc3-453d-9d91-1e438a63b2aa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:54.995610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95d71ac-4cc3-453d-9d91-1e438a63b2aa None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:54.997217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 177/348] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:54.997839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d71ac-4cc3-453d-9d91-1e438a63b2aa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.090857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 172/349] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:55.091757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.147556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95d71ac-4cc3-453d-9d91-1e438a63b2aa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.155965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.203044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.204534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.205193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.205656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.208310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.209855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6532e-7afa-4cf1-b3ed-5d22328293cd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.212070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 178/350] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:54 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:55.213338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.213623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.213898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.215921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748fa17-3b1c-4f3c-8c3c-9e5a2269d014 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.241725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:55.243865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:55.276180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.277479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.278361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.278866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.331510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.368026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 179/351] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:55.369526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.382775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.384289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.452965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.518443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecf667a-be82-4df7-b078-80edf765c94d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.543701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 173/352] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:55.548773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.559656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.560532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.560782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.561083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.562377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.563939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a538d9-3f9c-489f-92da-c25034ce6b46 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.565535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 180/353] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:55.568118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354fea5-e30e-4933-961d-394b16d9b3b6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.568557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354fea5-e30e-4933-961d-394b16d9b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.568669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354fea5-e30e-4933-961d-394b16d9b3b6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.570206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 181/354] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:55.571123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da553a-bd88-43f5-ac17-264580f89f51 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.571399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da553a-bd88-43f5-ac17-264580f89f51 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.571668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da553a-bd88-43f5-ac17-264580f89f51 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.573497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 182/355] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:55.573608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da553a-bd88-43f5-ac17-264580f89f51 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.641875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.671631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd21445-cdc3-4949-a8ec-a698d3aac84e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.712017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da553a-bd88-43f5-ac17-264580f89f51 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.718208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.719106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.719387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.719664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.730810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.732368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.734632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 174/356] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:55.739456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.750313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.751458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.751922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.752375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.765712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:55.765969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:55.774241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:55.775397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:55.776233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 183/357] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:55.776991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:55.876300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68a8115-64ee-408b-9285-05f652d95cdb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.907545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7244b6b-2c90-4920-84cb-1e2a1a9b65e1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:55.919634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.920522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.920808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.921089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.922159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:55.923093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.925011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9460e698-fb1a-4061-93c9-56304c6e1e03 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.927931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 175/358] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:55.929579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.929863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.930350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.951530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:55.952408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.952691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.952966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.953092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:55.954227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:55.955182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:55.955745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e628ad0-58a3-4931-8689-1fadc1ab51c0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:55.957791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 184/359] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:55 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:55.958795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:55.959079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:55.959353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:55.981546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:55.982876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:56.051277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 176/360] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:56.052248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.083551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.088741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 185/361] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:56.090018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.206973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54b07b8-df83-4ed4-b1b9-f0cef397f461 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.210857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d014aa-af8b-43da-a483-d241f199b34f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.219077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.254795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.255577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.256312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.256312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.258028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:56.258028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.260582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.260735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:56.260835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.260835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.260835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.261380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:56.261688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.263212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:56.267279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 177/362] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:56.269313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.284886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 186/363] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:56.284886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.395648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.432164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0acfc-bcf1-44ae-93ed-f4a0f8fb2f58 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.459868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1c89c-b8b0-4645-bd7c-dc46a94f40af None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.484707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.486773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.487776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.488574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.491456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.492963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:56.494948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 178/364] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:56.495506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.533188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.534532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.535287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.535811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.537382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:56.537955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.542591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:56.551398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 187/365] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 260 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:56.555942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.628271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.685996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4eb092-bce9-49bd-92e6-455cdc51c37a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.706606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a81c51-5345-4731-97c9-02ef698acd40 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.750997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.752077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.752494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.752916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.763665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.764821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.765213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.765594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.767157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:56.777757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:56.778824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:56.779644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:21:56.781533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:56.782305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 188/366] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:56.783298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:56.791211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:56.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:56.793030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 179/367] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:56.793686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:56.805049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.935528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:56.944418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4a534-1924-47a2-a3a6-5787e612fefa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.945132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f00bc9-b880-4031-8375-4497b73300e8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:56.994693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.995513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.995708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:56.995815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.996061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.996669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:56.996920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=a048bcfd9df2467287b5c8be01f262f0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:56.997017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:56.997213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] PATH_INFO: `/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:56.997321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.998549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] RBAC: Authorizing `identity:get_user(user_id=b81c7f566f334b4a8bcefb56fe0d90bd)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:56.998913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.000035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.006930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 189/368] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/users/b81c7f566f334b4a8bcefb56fe0d90bd => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:57.007851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.012833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 180/369] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:21:56 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 260 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:57.014240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.137790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a785ff-8c2d-4a12-b2b1-1afaad3a881f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:57.161783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:57.201382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:57.202399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:57.202687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:57.203511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:57.204593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:57.204910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:57.206406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.208639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a7d532-7473-4040-9f83-3cdb61b4918d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:57.219866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 190/370] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:57.222308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.258985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:57.272145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:57.274174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:57.274467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:57.274749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:57.276343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:57.276680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:57.278838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.299963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 181/371] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:57.301036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.390374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe33cb-f029-4e30-9eee-8d497da075a0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:57.440443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc76e3-6826-44d1-8a3e-a828038d81c1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:57.468700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:57.469425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:57.469710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:57.469988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:57.470911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] RBAC: Adding query filter params (role.id=461a6fd6e16d4729a46f450f9fcc4405, user.id=b81c7f566f334b4a8bcefb56fe0d90bd, scope.system=all) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:57.471234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:57.472775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.474742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:57.484341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:57.485005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:57.485287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:57.485563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:57.496433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 191/372] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/role_assignments?user.id=b81c7f566f334b4a8bcefb56fe0d90bd&scope.system=all&role.id=461a6fd6e16d4729a46f450f9fcc4405 => generated 510 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:57.496433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.641032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:57.671951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0559472-9242-40a6-ad59-c8c59339ab11 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:57.679478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:57.681319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.736373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:57.737052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:57.737335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:57.737607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:57.848208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:57.849759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:57.933211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 182/373] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:57.938514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:57.962589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:57.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 192/374] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:21:57.995930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:58.002360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:58.146535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e9e7a8-db8b-45d1-b0c9-77c1b0d91389 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.189794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da880a-ccc0-4441-9be1-4f6f9b736fd6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.234577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.236248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.237986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.238630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] PATH_INFO: `/v3/projects/ebccc8110983425eae462769b51519c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.240182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] RBAC: Authorizing `identity:get_project(project_id=ebccc8110983425eae462769b51519c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.242366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.243740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.244852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.244985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 193/375] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/projects/ebccc8110983425eae462769b51519c6 => generated 344 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:58.245479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.245938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.248394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.250204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.252467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 183/376] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:57 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:58.258796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:58.260989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:58.370475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:58.395854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:58.399765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb0df8-18b1-4a9f-b5e0-6f4737c35a5a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.437228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35673de-44f3-49e6-99a6-3571d97d5118 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.450704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.452181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.452617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.453026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.454503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.456132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.458417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 184/377] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:58 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:58.466007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:58.481568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.482846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.483281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.483699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] PATH_INFO: `/v3/groups/c09af817f6d54b24aef99b8502e66e4f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.497167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] RBAC: Authorizing `identity:get_group(group_id=c09af817f6d54b24aef99b8502e66e4f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.498933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.501127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 194/378] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:58 2022] GET /identity/v3/groups/c09af817f6d54b24aef99b8502e66e4f => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:58.511126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:58.593936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c022cf7-18c9-4302-a64a-2cf7fca910fc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.636724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80d855-726a-45f6-ba89-29afd640f280 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:58.637130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.638033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.638582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.639065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.640178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=a048bcfd9df2467287b5c8be01f262f0) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:58.640685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.643656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d565260-02dc-4650-a889-93bb3583e5f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.651096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 185/379] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:21:58 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:58.654424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:58.680163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:58.680870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.681155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.681432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.682368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] RBAC: Adding query filter params (group.id=c09af817f6d54b24aef99b8502e66e4f, role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=ebccc8110983425eae462769b51519c6) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:58.682682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:58.684479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79153c77-7e5c-4731-8c42-14545a0409ab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:58.692259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 195/380] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:21:58 2022] GET /identity/v3/role_assignments?group.id=c09af817f6d54b24aef99b8502e66e4f&scope.project.id=ebccc8110983425eae462769b51519c6&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:58.844526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591551-fccf-4e67-977a-b022a0c606e5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.845217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591551-fccf-4e67-977a-b022a0c606e5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.845735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5591551-fccf-4e67-977a-b022a0c606e5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.847977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 186/381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:58.855137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:58.855820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:58.856301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:58.877310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:58.879050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:58.966775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 196/382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:21:58.990792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5591551-fccf-4e67-977a-b022a0c606e5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.024840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:59.119646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5591551-fccf-4e67-977a-b022a0c606e5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.160679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.161630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.161914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.162218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.181012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-335cfd3d-bd75-47f1-b6bd-e0cb30f5e3a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:59.189420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:59.190361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:59.191171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 187/383] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:21:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:21:59.197112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.328180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9dbe-5df1-4907-b9bc-8c7a60e7f794 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.328811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9dbe-5df1-4907-b9bc-8c7a60e7f794 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.329284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a9dbe-5df1-4907-b9bc-8c7a60e7f794 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.331190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 188/384] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:59.336998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.337628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.338141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.356593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:21:59.359132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:21:59.375433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004eb58-b093-49ee-9810-b30e4fb7309f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.395127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:59.433619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.434729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.435210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.435700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.436684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:59.437206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:59.438841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:59.450394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 197/385] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:59.462860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.484527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 189/386] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:21:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:21:59.518508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.569409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:59.576882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581275e3-ccf5-44b3-945b-ea0ceb716a70 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.624209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.625517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.625995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.626523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.630879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:59.632648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:59.634922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 198/387] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:59.641662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.664979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f861e9e-5f1c-4588-8e78-f398faa98e3d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.701062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.702430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.702853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.703263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.717246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:21:59.725545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:21:59.726699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:21:59.727692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:21:59.728957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:59.730734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 190/388] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:21:59.737119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.798196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42173ef9-ab61-40b8-9f45-9f3e8da7b181 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.828035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:21:59.852736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.854163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.854514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.854885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.856991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a4c8ba-90b6-4a33-97c7-3dbb2dcb022f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:21:59.857805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:59.859466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:59.861589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 199/389] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:21:59.877801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:21:59.902462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:21:59.903859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.904375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.904656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.905413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:21:59.905718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:21:59.909392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918461ff-3749-4e58-9d7f-94c8fa2a0074 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:21:59.924142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 191/390] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:21:59.925749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852136d5-928d-401a-b97a-a151e9b385a7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:21:59.926358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852136d5-928d-401a-b97a-a151e9b385a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:21:59.926795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852136d5-928d-401a-b97a-a151e9b385a7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:21:59.928293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 192/391] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:21:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:21:59.933803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852136d5-928d-401a-b97a-a151e9b385a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.023035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a153db-d30f-4019-bfbe-3857b5bf2241 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.032992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:00.063463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852136d5-928d-401a-b97a-a151e9b385a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.068527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.069950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.070356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.070640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/groups/309f116b60bc4f68aad656840d91cb1d/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.073394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, group_id=309f116b60bc4f68aad656840d91cb1d, role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.075304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fcd4-f927-4d3e-97bc-b2d663f26999 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.096995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 200/392] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jun 21 10:21:59 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/groups/309f116b60bc4f68aad656840d91cb1d/roles/bacfbe396cb341d7a82bead66b616b8f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:00.102304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.102304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.102304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.115469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.116830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.117329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.117869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.121648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.122240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:00.123515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:00.124006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.126411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 193/393] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:21:59 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:00.132832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.151309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:00.218221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 201/394] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:00.237615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.335223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d643c-835a-402c-959a-1e804ec328e0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.349431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:00.357818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017f600f-ea30-49f0-9f77-c8091730dba8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.386474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.387516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.388204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.388491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.390231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.392104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.394491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 194/395] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:00 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:00.400637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.401834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.402843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.403212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.403495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.417783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:00.433319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:00.434349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:00.435162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 202/396] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:00.440787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.563200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:00.591450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4f3964-8f8e-4a8a-b337-9725ee0dd65b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.600030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29e6998-eaec-424c-a56e-8d81d04f9ef0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.654850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.655687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.655971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.656246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/groups/309f116b60bc4f68aad656840d91cb1d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.662288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] RBAC: Authorizing `identity:create_grant(project_id=869fd7dffeb64aecb753d35aba1d2d68, group_id=309f116b60bc4f68aad656840d91cb1d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.663809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.669515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.670351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.670646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.670968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.671736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:00.672048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.673753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.685088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 203/397] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:22:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:00.697346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 195/398] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jun 21 10:22:00 2022] PUT /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68/groups/309f116b60bc4f68aad656840d91cb1d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:00.698502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:00.724262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:00.823610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327d30e2-8230-4dd8-939b-b4a26363e17d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:00.863486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:00.864779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:00.865063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:00.865387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:00.866689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:00.868439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:00.870636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 204/399] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:00 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:00.879953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.059234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a4161-82d0-455b-b8ba-bc92fba3220b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:01.146616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:01.147949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.148422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.148892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.150400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:01.152059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b91c1-15fd-4014-857b-b0ba31a55d19 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:01.153987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 196/400] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:00 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:01.160661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.338827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804ed4-3f97-4686-a993-f6336798162e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.339146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804ed4-3f97-4686-a993-f6336798162e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.339321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58804ed4-3f97-4686-a993-f6336798162e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.342163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 197/401] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:01.343354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6d63-75c0-42f3-a34c-b7aeb0641603 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.343639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6d63-75c0-42f3-a34c-b7aeb0641603 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.343921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb6d63-75c0-42f3-a34c-b7aeb0641603 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.347132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:01.348325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 198/402] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:01.350211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.351118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.351118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.369995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:01.371242 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:01.373557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:01.377055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52b6d-595a-41c5-b70a-dd0c8571ad77 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:01.418256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:01.419887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.420471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.420920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/groups/309f116b60bc4f68aad656840d91cb1d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.423247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, group_id=309f116b60bc4f68aad656840d91cb1d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:01.424999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83d6c2-ace0-46cc-a332-c3cf83c44617 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:01.442232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 205/403] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jun 21 10:22:01 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/groups/309f116b60bc4f68aad656840d91cb1d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:01.444533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.445586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.446381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.455362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 199/404] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:01.471525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:01.473262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:01.495166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.564705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 206/405] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:01.587526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.693954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efbfab-cb21-43e9-9322-46dc4f1a50be None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:01.701071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:01.730005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bec17-23d5-4eee-9731-02655ec0ef53 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:01.745798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:01.746691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.746969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.747235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.758761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:01.764793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:01.773759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:01.774648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:01.774935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:01.775222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:01.775360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:01.776283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:01.777144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 200/406] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:01.786713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.802487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:01.811456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:01.812724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:01.813870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:01.816879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 207/407] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:01.822543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:01.977029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f1dc8-2bc1-4ddd-86b8-ef0fe6913d6e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:01.980360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237044cd-ca01-4e45-a819-9c91a0f69a43 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.017175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.017951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.018340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.018616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.019904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:02.020111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.020195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.021126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.021441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.021769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.021866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.022682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:02.022999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.024961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.035227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 208/408] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:02.035880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:02.038510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 201/409] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:02.042984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.060815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.165313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09533fd-1742-443c-a62c-9143e8c29e1c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.185940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:02.216973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.218686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.219445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.220207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] PATH_INFO: `/v3/groups/c09af817f6d54b24aef99b8502e66e4f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.222769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] RBAC: Authorizing `identity:get_group(group_id=c09af817f6d54b24aef99b8502e66e4f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.227167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.230094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 209/410] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:02 2022] GET /identity/v3/groups/c09af817f6d54b24aef99b8502e66e4f => generated 229 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:02.242629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.333409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b80fff-52d8-44fd-9f17-f7b2ba5b3c8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.342732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:02.390003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.391207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.391490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.391860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.393589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.395771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.398368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 202/411] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:02 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:02.405157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.444553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f801d-6546-4e02-b2b8-442231ada13d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.522036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e650d6a-5721-49cd-a23c-fa9826f2f1d6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.550596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:02.559085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.559962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.560243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.560520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.561750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.563253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.565313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 203/412] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:02 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:02.569670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.570609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.570890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.571162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] PATH_INFO: `/v3/projects/ebccc8110983425eae462769b51519c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.572964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.574346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] RBAC: Authorizing `identity:get_project(project_id=ebccc8110983425eae462769b51519c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.575814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.587445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 210/413] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:02 2022] GET /identity/v3/projects/ebccc8110983425eae462769b51519c6 => generated 344 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:02.588462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:02.775162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4f88da-18fc-4a91-bc3f-6057a0afdc27 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.806808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040dad8-e860-4a12-a316-a621a125be15 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:02.822232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.823356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.823653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.824030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0/groups/309f116b60bc4f68aad656840d91cb1d/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.826613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] RBAC: Authorizing `identity:create_grant(project_id=a048bcfd9df2467287b5c8be01f262f0, group_id=309f116b60bc4f68aad656840d91cb1d, role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.828292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec876c3-2eab-44ae-8866-a312114a0242 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.850861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 204/414] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jun 21 10:22:02 2022] PUT /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0/groups/309f116b60bc4f68aad656840d91cb1d/roles/bacfbe396cb341d7a82bead66b616b8f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:02.881364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:02.882325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.882607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.882890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] PATH_INFO: `/v3/projects/ebccc8110983425eae462769b51519c6/groups/c09af817f6d54b24aef99b8502e66e4f/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.887861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebccc8110983425eae462769b51519c6, group_id=c09af817f6d54b24aef99b8502e66e4f, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:02.889438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf5f64-9720-493b-b390-9f4276fe82a2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:02.892123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:02.915519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 211/415] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jun 21 10:22:02 2022] PUT /identity/v3/projects/ebccc8110983425eae462769b51519c6/groups/c09af817f6d54b24aef99b8502e66e4f/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:02.992748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec17b-b3f1-4ca2-919a-b2135415b0fa None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:02.993190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec17b-b3f1-4ca2-919a-b2135415b0fa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:02.993357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bec17b-b3f1-4ca2-919a-b2135415b0fa None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:02.995196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 205/416] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:03.001529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.001914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.002188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.030741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:03.032807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:03.144485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 212/417] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:03.174866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bec17b-b3f1-4ca2-919a-b2135415b0fa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:03.270707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:03.356442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bec17b-b3f1-4ca2-919a-b2135415b0fa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:03.400450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:03.402005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.402701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.403227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.415834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-92673272-7542-4985-95d7-5f89c8bbdb67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:03.426106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:03.427200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:03.428253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:03.435600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 206/418] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:03.439114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:03.546166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3609-4008-407c-a41b-ef01c145e3e9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.546442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3609-4008-407c-a41b-ef01c145e3e9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.546742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf3609-4008-407c-a41b-ef01c145e3e9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.548389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 207/419] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:22:03.554754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.555046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.555326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.589154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed182511-d19b-4f9f-8630-fadb0a6c20ba None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:03.604205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:03.605271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:03.629794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:03.656360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:03.657057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.657347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.657624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.658417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:03.658729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:03.661219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:03.675350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 213/420] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:03.681235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:03.741925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 208/421] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:03.809425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:03.836555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d66bd4-07c9-44ca-be0e-75b329214d38 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:03.884979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:03.885728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:03.886009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:03.886399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:03.952065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:03.992970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.027400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.029167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.037172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faaea0f-0b0b-485a-bad8-5c59a84355f1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.075815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.077093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.077576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.078043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.090522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:04.099397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:04.100531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:04.101325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:04.104508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 209/422] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:04.110486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.218299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab30079d-91bd-49f3-b019-33d352a6d82d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.242589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.271639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.273790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.274378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.274851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.275817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:04.276661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.278459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.289244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 210/423] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:04.295825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.377253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 214/424] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:04.387178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.420942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe03503-9ddc-4a2b-949a-6d949f0f11d8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.461977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.463132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.463742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.464234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.504524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.529216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.549083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c605d5f4-b239-47ce-9611-9177bc9b1ef2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.556821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.558778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2684765-893b-41ff-8dc9-f4b3f6c56018 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.595016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.596819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.597402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.597906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.599631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.601746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f83d6-4a03-47c1-b2ef-f844677b3c46 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.605039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 215/425] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:04.606924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a170e0-f6ac-44cc-ba2b-d776bc94e605 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.607409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a170e0-f6ac-44cc-ba2b-d776bc94e605 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.607957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a170e0-f6ac-44cc-ba2b-d776bc94e605 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.614911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 216/426] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:04.616055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a170e0-f6ac-44cc-ba2b-d776bc94e605 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.696226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 211/427] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:04.698023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.698449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.698820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.717106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:04.718496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:04.733687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a170e0-f6ac-44cc-ba2b-d776bc94e605 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.774956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.776193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.776612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.777019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.778528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.780414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.782418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 217/428] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:04.783698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.795423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.810082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 212/429] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:04.810082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.830081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:04.922206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142397b-707d-490d-a8a4-f1cc833588e0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.938797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbee769-f81f-461e-83b7-942c78eea0dc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:04.961365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.962641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.963091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.963573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] PATH_INFO: `/v3/projects/869fd7dffeb64aecb753d35aba1d2d68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.965117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] RBAC: Authorizing `identity:get_project(project_id=869fd7dffeb64aecb753d35aba1d2d68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.966926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.969068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 218/430] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/projects/869fd7dffeb64aecb753d35aba1d2d68 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:04.970125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:04.977423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:04.979008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:04.979410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:04.979754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:04.980715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:04.981094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:04.982822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:04.990426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 213/431] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:04.991399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.077924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.078579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.091971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da842b3-1d7f-45ae-8da0-0365f827ea72 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.132329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.133495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.133948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.134444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.147846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:05.152025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850e272-add5-442c-b924-6cebc5765d77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:05.156616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:05.157555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 21 10:22:05.158386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:05.160492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 219/432] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:05.166699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.207876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.208250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.208534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.208808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.210341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:05.211883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:05.214281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 214/433] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:04 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:05.220172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.290235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246e90e-35e6-408c-a682-f77e8d8a077c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.331200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.332235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.332706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.333195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.334266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:05.334795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:05.336511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:05.353646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 220/434] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:05.355736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.370390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b32ff-d10a-49af-b45f-45fac7cd0089 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.375775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.404952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.411639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.412358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.412720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.412957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.413809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=869fd7dffeb64aecb753d35aba1d2d68) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:05.414173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:05.415939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee1757-0bf0-4eed-a147-27546ad5f449 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:05.422464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 215/435] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=869fd7dffeb64aecb753d35aba1d2d68&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:05.484339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24b583-80e5-4a35-afce-e2eef81a2b28 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.523856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.525015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.525520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.526166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.608279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:05.610572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd4c6a9-62c2-45a6-a30a-6b08037099b3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:05.627267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.632994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347128-ea4e-45a1-9c7e-f277d79b8ce5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.633304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347128-ea4e-45a1-9c7e-f277d79b8ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.633556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d347128-ea4e-45a1-9c7e-f277d79b8ce5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.635308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 216/436] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:05.641567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095e33-39cd-49b2-81d9-bdf8a91814f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.641871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095e33-39cd-49b2-81d9-bdf8a91814f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.642165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00095e33-39cd-49b2-81d9-bdf8a91814f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.670071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00095e33-39cd-49b2-81d9-bdf8a91814f7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:05.672053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00095e33-39cd-49b2-81d9-bdf8a91814f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:05.738189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 221/437] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 21 10:22:05.740184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e8c-3594-4b13-8836-0f64b82def12 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.740577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e8c-3594-4b13-8836-0f64b82def12 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.740748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb65e8c-3594-4b13-8836-0f64b82def12 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.742173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 222/438] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:05.743191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65e8c-3594-4b13-8836-0f64b82def12 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.772012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 217/439] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:05.773363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.773650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.773948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.797909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:05.800031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:05.892786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 218/440] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:05.893787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.899679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb65e8c-3594-4b13-8836-0f64b82def12 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:05.915616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:05.947309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:05.948188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:05.948650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:05.949077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:05.950453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:05.952122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:05.958976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 223/441] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:05.961159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:05.979398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.045991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86b7502-9d0c-41ac-a07b-3734224b80df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.096926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.098803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.099270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.099758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.115942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b5ab89-a6f7-42ad-a853-ebd1cabc76d8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.120198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:06.129892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:06.131132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:06.132119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:06.134604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 219/442] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:06.135513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.158488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.159248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.159519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.159792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.171919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:06.180441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:06.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:06.182294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:06.186252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 224/443] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:06.187799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.235774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.247689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af65f5-20e9-4d85-a781-f228a5fa48f7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.265357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.296694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.298046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.298522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.298928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.301308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.304066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.306094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89f412-6ff4-4279-ba06-420521c6798d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.307263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 220/444] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:06.308147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.346102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.346816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.347101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.347377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.348784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:06.349093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.355944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.369243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 225/445] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:06.370178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.434771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01183168-9713-4dac-9944-aa3484b91aa0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.472161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.473284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.473638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.473919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.474749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:06.475064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.476523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.486198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 221/446] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:06.487288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.494643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1f4e80-43ab-4e00-b564-04f55cb85f3c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.496329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.532984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.533649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.533933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.534252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.535093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=4ccbd5b0e5ba4d53aee626148246e880, scope.project.id=a048bcfd9df2467287b5c8be01f262f0) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:06.535414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.536884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.538585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.544183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 226/447] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=4ccbd5b0e5ba4d53aee626148246e880 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:06.557430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.610355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ad3e74-2149-40b4-92cc-4204e27506ce None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.653859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.654800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.655033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.655380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.665683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb37457-623e-4e63-9f13-deeb524fb662 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:06.705720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:06.706315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:06.706604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:06.706872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:06.734226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.736523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.750198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.788229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:06.789765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:06.790761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.862216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 222/448] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:06.868255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.906110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 227/449] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:06.909363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:06.977693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:06.981270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e0dc52-8351-4420-835f-de87e2bf30c6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.012848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c913f-5ae5-49ef-aa5f-342022d4acf4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.016930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.017800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.018093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.018377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] PATH_INFO: `/v3/projects/ebccc8110983425eae462769b51519c6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.019647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=ebccc8110983425eae462769b51519c6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.021100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.022820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 223/450] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/projects/ebccc8110983425eae462769b51519c6 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:07.028370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:07.043322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:07.048283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.049174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.049457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.049730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] PATH_INFO: `/v3/projects/a048bcfd9df2467287b5c8be01f262f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.050990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] RBAC: Authorizing `identity:get_project(project_id=a048bcfd9df2467287b5c8be01f262f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.052475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.054217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 228/451] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:22:06 2022] GET /identity/v3/projects/a048bcfd9df2467287b5c8be01f262f0 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:07.059945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:07.132898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2e2ed-9f9e-4cc0-9ddc-18f98948c6c9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.161731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae64254-b8c9-4e19-9827-6ecf70f5fe69 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.168237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.169117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.169394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.169670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] PATH_INFO: `/v3/groups/c09af817f6d54b24aef99b8502e66e4f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.170913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] RBAC: Authorizing `identity:get_group(group_id=c09af817f6d54b24aef99b8502e66e4f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.172361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.173998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 224/452] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:07 2022] GET /identity/v3/groups/c09af817f6d54b24aef99b8502e66e4f => generated 229 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:07.180158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:07.197958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.198875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.199159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.199456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] PATH_INFO: `/v3/groups/309f116b60bc4f68aad656840d91cb1d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.200618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] RBAC: Authorizing `identity:get_group(group_id=309f116b60bc4f68aad656840d91cb1d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.202123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.203922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 229/453] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jun 21 10:22:07 2022] GET /identity/v3/groups/309f116b60bc4f68aad656840d91cb1d => generated 226 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:07.209831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:07.212673 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:07.267250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:07.289510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c550a-07b9-44cb-a389-7a292c51aead None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.317157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7d6dde-d2af-453b-94ed-246e73e7b239 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:07.323303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.323963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.324236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.324503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.325336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] RBAC: Adding query filter params (group.id=c09af817f6d54b24aef99b8502e66e4f, role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=ebccc8110983425eae462769b51519c6) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:07.325640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.327483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c37c90-3f97-4b44-953a-b8f1d34b02f8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.333666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 225/454] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:22:07 2022] GET /identity/v3/role_assignments?group.id=c09af817f6d54b24aef99b8502e66e4f&scope.project.id=ebccc8110983425eae462769b51519c6&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:07.354635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:07.355308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:07.355591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:07.355867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:07.356727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] RBAC: Adding query filter params (group.id=309f116b60bc4f68aad656840d91cb1d, role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=a048bcfd9df2467287b5c8be01f262f0) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:07.357045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:07.358604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b03dd3-0c1e-4b41-93b6-428c77321213 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:07.365438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 230/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jun 21 10:22:07 2022] GET /identity/v3/role_assignments?group.id=309f116b60bc4f68aad656840d91cb1d&scope.project.id=a048bcfd9df2467287b5c8be01f262f0&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:10.031458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8866-787e-451d-b6ae-a923dd25dcd5 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.032343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8866-787e-451d-b6ae-a923dd25dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.032787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a8866-787e-451d-b6ae-a923dd25dcd5 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.034405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 226/456] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:10.040017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.040810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.041282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.063130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:10.064775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:10.138590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:10.154598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 231/457] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:10.193377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.193636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64356-e142-4745-9e04-ec0250a37534 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.194207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64356-e142-4745-9e04-ec0250a37534 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.194666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e64356-e142-4745-9e04-ec0250a37534 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.196503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 227/458] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:10.222694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60750e1-6e1c-4df0-82a4-da26aa6c63d4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.223507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60750e1-6e1c-4df0-82a4-da26aa6c63d4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.224101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60750e1-6e1c-4df0-82a4-da26aa6c63d4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.225992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 228/459] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:10.227367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5806-bd03-4041-9ee6-7532eb79782b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.227851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5806-bd03-4041-9ee6-7532eb79782b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.228702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5806-bd03-4041-9ee6-7532eb79782b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.246439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-af7a5806-bd03-4041-9ee6-7532eb79782b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:10.248123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-af7a5806-bd03-4041-9ee6-7532eb79782b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:10.320917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd11818b-1689-4d00-8d18-de6856eecc05 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:10.364142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 229/460] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:10.365967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.366473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.366948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.367286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:10.368263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.368825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.369241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.387139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:10.388906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:10.393522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:10.394827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:10.410185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:10.411361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:10.412423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:10.412423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:10.412423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.412423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:10.414337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 232/461] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:10.415330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.482561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 230/462] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:10.483788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.484631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:10.506445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:10.558001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0e6e8-a51d-44b3-b5af-6dd6fcfd0cf9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:10.601026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:10.602215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.602697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.603510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.617283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:10.619209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:10.631988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae6614-926e-445a-832f-15f7e0499323 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:10.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:10.639459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:10.640303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:10.640303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:10.640303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.640303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:10.642777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 233/463] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:10.643912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.676986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:10.677671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.677940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.678389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.682034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:10.682548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:10.686315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:10.700836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 231/464] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:10.701938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.764318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:10.769431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26e2e2-9bd5-437f-925d-ab78c60750d1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:10.784057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:10.810156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:10.811167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.811509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.811999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.824525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:10.827797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:10.847669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0df56-3cc7-4d0a-a35a-0f97101e3f75 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:10.851648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:10.852496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:10.853698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:10.853698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:10.853698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:10.853698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:10.857963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 234/465] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:10.859448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.902563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136792f-7408-4858-9849-6fcea764497f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:10.903624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136792f-7408-4858-9849-6fcea764497f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:10.904181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136792f-7408-4858-9849-6fcea764497f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:10.905075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136792f-7408-4858-9849-6fcea764497f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:10.906040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136792f-7408-4858-9849-6fcea764497f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:10.906613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136792f-7408-4858-9849-6fcea764497f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:10.908792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136792f-7408-4858-9849-6fcea764497f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:10.923656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 232/466] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:10.924846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136792f-7408-4858-9849-6fcea764497f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:10.973468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc2321e-2cd9-438a-a5ea-25be2212b9cf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.009736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.010449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.010716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.010988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.011694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.013175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.042166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 235/467] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:10 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:11.042166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.054439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.077080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136792f-7408-4858-9849-6fcea764497f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.117575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.136414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.137145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.137462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.137749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.138775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:11.139160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.140762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73f43f-3014-43c0-a595-3238ebc3ce1f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.164507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 233/468] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:11.166528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da2b9-a47f-465e-a6da-5c44b0d98e4b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.167395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da2b9-a47f-465e-a6da-5c44b0d98e4b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.168295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373da2b9-a47f-465e-a6da-5c44b0d98e4b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.171138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 234/469] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:11.181598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.181598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.181598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.202920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:11.204213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:11.226940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439785-7722-4f9b-94aa-5ad7c69e3a02 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.290094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.290094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.291604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.291789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.292523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.294530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.323551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 235/471] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:11.323789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 236/471] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:11.330148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.355888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.456735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.493764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554197-013b-489f-8dcf-85977d3db8a3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.511855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.518369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7260f477-bae4-426e-9e3d-ccca89a7a142 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.535198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.536049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.536290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.536566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.548885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.550422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.566036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b116de-a548-4d11-b364-582595c39914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.567465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b116de-a548-4d11-b364-582595c39914 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.568005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b116de-a548-4d11-b364-582595c39914 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.568481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b116de-a548-4d11-b364-582595c39914 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.569407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b116de-a548-4d11-b364-582595c39914 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:11.570720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:11.571568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:11.572411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:11.572411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:11.572411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:11.572411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:11.572411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 236/472] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:11.574393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b116de-a548-4d11-b364-582595c39914 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.578471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.601000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 237/473] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/users => generated 248 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:11.625274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e44cb-6bf4-47b8-90e5-3af53038f261 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.625648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e44cb-6bf4-47b8-90e5-3af53038f261 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.625851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e44cb-6bf4-47b8-90e5-3af53038f261 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.627627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 238/474] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:11.633832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.634254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.634521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.671725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:11.672962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:11.738479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72d2ac-0b13-405b-91c1-e95e4a822e57 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.772485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 239/475] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:11.785206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.786391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.786879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.787433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.788441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:11.788953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.790639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.798108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.806304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 237/476] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:11.812565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:11.847880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.857895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:11.936099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e137097-c015-4729-bdf1-a223862bce6f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.953851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df3099-b7e6-41e6-a5d5-761d52469230 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:11.978718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.979634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.980047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.980480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.981361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:11.982938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:11.994382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.sql.core [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 10:22:11.994382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 10:22:11.994382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [parameters: {'id': '0d6021c5500649e281016c415015a9c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 10:22:11.994382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80174) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 10:22:11.996414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:11.997257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:11.997682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:11.998161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:11.999031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:12.000593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:22:12.013636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return ref.to_dict() Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:22:12.014701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application yield resource Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise self.value Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application session.commit() Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 10:22:12.015650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.flush() Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application compat.raise_( Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 10:22:12.016514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:22:12.017419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:22:12.019580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [parameters: {'id': '0d6021c5500649e281016c415015a9c4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:12.021619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 21 10:22:12.023885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.027184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 240/477] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:12.027184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:12.039422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 238/478] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:11 2022] POST /identity/v3/users => generated 249 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:12.149017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8515782-7832-4563-80f3-dffaaeb30a64 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:12.165515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:12.191634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:12.192480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:12.193022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:12.193632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:12.205827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4613dc7c-1a48-4259-b530-6f8d2a2e821f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:12.214424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:12.215401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 21 10:22:12.216216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:12.219462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 241/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:12.222539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:12.325670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:12.344467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7039-8927-4af8-bf5f-0e81885e8e0f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:12.380695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:12.381369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:12.381653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:12.381926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:12.382717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:12.383026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:12.384419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149b2c51-a26d-4f4b-87df-0dc31bbf65fa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:12.393369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 239/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:13.787055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086523f6-670c-42f2-b62c-1a2b8cb68570 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:13.788105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086523f6-670c-42f2-b62c-1a2b8cb68570 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:13.788579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086523f6-670c-42f2-b62c-1a2b8cb68570 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:13.790202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 242/481] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:13.795591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b2ca-5d04-4906-b1f4-9e8bcabbb2f2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:13.796434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b2ca-5d04-4906-b1f4-9e8bcabbb2f2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:13.796919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635b2ca-5d04-4906-b1f4-9e8bcabbb2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:13.818101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9635b2ca-5d04-4906-b1f4-9e8bcabbb2f2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:13.819652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9635b2ca-5d04-4906-b1f4-9e8bcabbb2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:13.908054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 240/482] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:13.950296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086523f6-670c-42f2-b62c-1a2b8cb68570 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:13.990587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6f2d-fbc7-4f83-84d2-1d8458099c26 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:13.991256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6f2d-fbc7-4f83-84d2-1d8458099c26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:13.991748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caa6f2d-fbc7-4f83-84d2-1d8458099c26 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:13.994760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 241/483] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:22:14.000511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.000818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.001088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.027088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:14.028321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:14.121885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086523f6-670c-42f2-b62c-1a2b8cb68570 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.159523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.160438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.160722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.161001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.172851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:14.181063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:14.181949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:14.183187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 243/484] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:14.188416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.207894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 242/485] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:14.241666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.263180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.277239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.320729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273ea820-1e56-4743-8453-46064387a0ae None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.367924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.368844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.369135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.369417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.370780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:14.371250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:14.373060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c724d81f-6134-4297-a4ab-4ed299769749 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:14.388191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 244/486] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:14.391200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7428-38f8-4ea3-8476-618c66ae662b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.391531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7428-38f8-4ea3-8476-618c66ae662b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.391809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c7428-38f8-4ea3-8476-618c66ae662b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.398218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 245/487] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:14.399070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7428-38f8-4ea3-8476-618c66ae662b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.413995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3081f2c-a322-44de-babd-bc12b9d74544 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.451291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.452101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.452381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.452653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.464165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8f0ee6a0-df42-4f5a-8557-79e7022640fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:14.471896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:14.473061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:14.474153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 243/488] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:14.474976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.474976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.474976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.495875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:14.497192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:14.532441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.542403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c7428-38f8-4ea3-8476-618c66ae662b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.569306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.580450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.581181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 244/489] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:14.581480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.581916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.582351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.582759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.594645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:14.596717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:14.617391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:14.618526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:14.619601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:14.619601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:14.619601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:14.619601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:14.621369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 246/490] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:14.626224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.699978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71bd616-9bfe-464b-9d3f-eeb364b9bbb5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.737300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.738489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.738975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.739443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.740053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc829ac-f772-4a87-9487-c640f0299f10 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.740620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:14.741140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:14.742769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:14.752060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 245/491] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:14.753201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.776442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.777243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.777526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.777803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.788877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:14.796756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:14.797685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:14.798545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:14.803020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 247/492] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:14.803954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.815712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.821791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:14.869813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bace2a-e841-404a-8e07-a1fae87fe377 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.906944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.907639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.907925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.908202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.908927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:14.909233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:14.910790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:14.917325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf35cc91-ce81-4813-b0ef-332805e1b6b3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:14.927902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 246/493] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:14.927902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:14.956535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:14.957484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.957767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.958045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.969034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:14.970555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-94222099-9fb1-47fa-a97c-9042e5fefa82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:14.988796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:14.989890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:14.991060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:14.991060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:14.991060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:14.991060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:14.991060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 248/494] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:14.991831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd461d-a14e-4b4e-af26-27e26dd25f52 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:14.992117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd461d-a14e-4b4e-af26-27e26dd25f52 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:14.992392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd461d-a14e-4b4e-af26-27e26dd25f52 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:14.993791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 249/495] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:14.996676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd461d-a14e-4b4e-af26-27e26dd25f52 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.029667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25f4d2-1b1d-467d-b4cf-4716bd7f5acd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.048730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.065175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.068999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.069703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.069980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.070286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.071044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:15.071352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.072759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.085700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 247/496] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:15.085700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.114317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd461d-a14e-4b4e-af26-27e26dd25f52 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.152275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.153071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.153352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.153697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.161436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.162865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-31bd24fb-b6af-40ff-b011-a0384c761949 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:15.178323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:15.179398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:15.180594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 250/497] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:15.181284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c40dda-39c6-4fb0-bc2a-235c5f76c7d6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.181368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c40dda-39c6-4fb0-bc2a-235c5f76c7d6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.181582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c40dda-39c6-4fb0-bc2a-235c5f76c7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.191506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3783c7c-490c-44f7-bd85-419be53b62b0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.198780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-73c40dda-39c6-4fb0-bc2a-235c5f76c7d6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:15.199978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-73c40dda-39c6-4fb0-bc2a-235c5f76c7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:15.229142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.229886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.230210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.230489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.231214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:15.231506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.232896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.244860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 248/498] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:15.245666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.274654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 251/499] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:15.276006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9b15-f7fa-46db-ae64-ed79eed6bebe None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.276284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9b15-f7fa-46db-ae64-ed79eed6bebe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.276558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bb9b15-f7fa-46db-ae64-ed79eed6bebe None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.277794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 252/500] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:15.278490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb9b15-f7fa-46db-ae64-ed79eed6bebe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.299044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.332801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.363235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ac53f-e26e-4122-92d8-aedae47e2f31 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.384718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bb9b15-f7fa-46db-ae64-ed79eed6bebe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.396946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.397757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.398043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.398345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.408473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.409962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.419186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.419841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.420117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.420395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.421219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:15.421521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.423021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b634f51-8284-455a-bd06-697e01e214b1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:15.428036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:15.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:15.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:15.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:15.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:15.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:15.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 249/501] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:15.430297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.460508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 253/502] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:15.461870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.462192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.462470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.478725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:15.479928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:15.527643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.537281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e23b63-b82b-48c4-8455-1d23ca12f936 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.547209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 254/503] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:15.548061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.580596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.581409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.582030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.582030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] PATH_INFO: `/v3/users/glance` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.589869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.591372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.593732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:15.608442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:15.609514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 250/504] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:15.610558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.660175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa056fc-6066-4b5c-9991-2893085b9166 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.694340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.695057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.695315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.695594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.706236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:15.707264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a316c9-bc2d-4613-9c36-a7bb26aca3ec None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:15.714253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:15.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:15.715960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 255/505] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:15.716668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.746154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.746819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.747108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.747387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.748109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:15.748421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.749822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.761340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 251/506] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:15.762155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:15.776348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.817460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:15.821554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed7205-cabb-468f-b973-327c2fa6e78f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.858624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.859281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.859563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.859832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.864877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7472d6-eea3-4bb4-9911-5f3f38fde3cf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:15.901430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:15.902282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:15.902568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:15.902843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:15.915753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.917249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.934013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:15.935569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:15.936748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:15.937697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:15.938598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:15.938598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:15.938598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:15.938598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:15.938598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 252/507] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:15.938883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.007586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.046232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.050306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b296a0-a0aa-41e5-932e-d6f4009b8c88 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.055717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 256/508] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:16.056540 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.088295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.088987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.089273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.089546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.090460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:16.090783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.092314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.133784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 253/509] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:16.134744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.167757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50e2646-0e17-4ee0-a612-0a888f514d37 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.205687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.206390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.206687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.207128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.207908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:16.208214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.209667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.218974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 257/510] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:16.219851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.252840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d133a-c1dd-463f-a6b2-b9bdcc1bc213 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.280133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.295933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.296757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.297036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.297305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.305655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.307184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.309526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:16.322502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:16.323481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:16.324675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 254/511] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:16.325457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.353697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ed8928-a47c-469f-ac7c-92ab2b1ca72c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.389829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.390519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.390796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.391063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.391787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:16.392087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.393513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.418141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 258/512] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:16.419053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.434641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e60a13-298a-489f-a500-f213fcd434f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.473151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.473957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.474270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.474547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.485850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.487488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:16.506016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:16.507079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:16.507968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:16.507968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:16.507968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:16.507968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:16.507968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 255/513] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:16.508243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.538289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0809db39-f6ea-4062-bebd-87a96e07e5de None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.549890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.561142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.582241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.583041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.583305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.583582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.628816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7556533b-24ed-4443-ad9f-2612efbfd738 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.656114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.657624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.663736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.664684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.665131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.665609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.676955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.678513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:16.701578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:16.702753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:16.703615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:16.703615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:16.703615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:16.703615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:16.703615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 256/514] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:16.704165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.773482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 259/515] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:16.774172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.799549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.802743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:16.822322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fe9013-0568-40db-a931-d818e6b9e2d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.858625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.859501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.860276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.860276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.860955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:16.861265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.862762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.881260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 257/516] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:16.882138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.906272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97483448-7741-4c4c-8cb1-d91555c7eaf8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:16.944574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:16.945250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:16.945523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:16.945792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:16.946526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:16.947991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:16.990086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 260/517] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:16 2022] POST /identity/v3/users => generated 247 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:16.990086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:16.998719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70a56f-7dd6-4763-b87c-082d50b37ee1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.049491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.050884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.051674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.051674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.053035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:17.053528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.055979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.085007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 258/518] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:17.086597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.091482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.117036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.150389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720145f4-963e-44a8-8bd4-7cb7dbd5552d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.191630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.192316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.192597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.192873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.193608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:17.193918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.195372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.208961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 261/519] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:17.209743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.235765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a4db9-e453-45cb-8311-d877b346dc3c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.279625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.280590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.280876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.281152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.292345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.293826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:17.311340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:17.312223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:17.313073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:17.313073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:17.313073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:17.313073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:17.313073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 259/520] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:17.313354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.320608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a8502-0bae-4b34-8271-30f066e76d69 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.364471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.365154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.365433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.365707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.370440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.373263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.426177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056c26-6020-4ad4-8017-089b350fdf6b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.449137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.450689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.464963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.465795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.466112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.466388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.480576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.483366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:17.511537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:17.512478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:17.513321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 260/521] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:17.513796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.573517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 262/522] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:17.574318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.610087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.620251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd7caed-32a9-4a9e-a358-3b3e01deebb9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.636205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.659036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.659974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.660267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.660574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.668723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.670211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.685719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf50143-d517-4903-9394-503dfae86b65 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:17.686207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:17.687087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:17.687969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 261/523] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:17.688537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.727517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.728551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.728834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.729113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.729845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:17.730186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.731602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.743371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 263/524] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:17.744203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.812687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f53e3-e20c-4a06-ae12-1578f6309c61 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.851601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.852453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.852741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.853379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.853757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.854211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:17.854520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.856015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.864057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f646d2b3-2b44-47c0-8432-15dafae61598 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:17.877130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 262/525] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:17.877916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:17.905828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:17.906740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:17.907356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:17.907356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:17.919135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:17.920806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:17.938419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:17.940391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:17.941693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:17.943578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:17.943578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:17.943578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:17.943578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:17.943578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 264/526] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:17.946614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.017611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b969c4-d161-4d82-93c5-c4ccc912598e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.053442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.054168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.054484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.054733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.055582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:18.055893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.057385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.077124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 263/527] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:18.077378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3b18f-23db-44af-954f-6746f10f843b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.078442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.122567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.123412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.123753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.124096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.131744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.133324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:18.151012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:18.151955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:18.152804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 265/528] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:18.153279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.165429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.216087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.226550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcd920-1c63-4570-8e46-995d2a20ee6f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.270135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895432-ff31-4090-b4bb-f1e3830acabf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.271501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.272737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.272737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.273864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.274755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:18.275068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.276547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.290096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 264/529] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:18.290096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.308959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.309640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.309923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.310227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.310999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:18.311306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.312786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.326644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 266/530] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:18.327602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.423006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.428892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf728afd-9981-4156-a121-32ccb2df22d4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.455475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3859e0-a4a0-4334-a5f2-91743d9ba5fb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.477098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.477313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.477571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.477845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.507040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.507412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.507736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.508017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.508778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.509931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:18.510266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.511858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.538029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 267/531] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:18.539256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.563115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.565025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.665116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948af99-0b49-4847-be75-6e1fc2a7f18b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.687973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 265/532] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:18.688765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.699125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.709026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.709879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.710205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.710483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.718465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.720004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:18.735425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:18.736969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 268/533] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:18.738596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.770226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:18.819973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5533b02-553c-45f8-ae71-3043e1c0d1aa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.858652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.859322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.859598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.859871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.860710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ee05ef1224e94100b841074a1ea6727c) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:18.861020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.862508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.863081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74c685e-6a91-4f60-8d73-b7b80237a802 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:18.870113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 266/534] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/role_assignments?user.id=ee05ef1224e94100b841074a1ea6727c&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:18.870964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:18.906265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:18.907488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:18.908678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:18.909624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:18.925397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:18.927404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:18.950140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:18.951212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:18.952284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:18.952284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:18.952284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:18.952284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:18.953501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 269/535] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:18.959624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.003489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630c22bb-0b42-40cc-9ddd-63db9012b1d9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.018898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.049750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.081181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.082337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.082629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.082934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.083854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:19.084164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.096289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.122948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 267/536] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:19.125140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.142988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa723f-7bf0-4522-a6a7-008df695e716 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.182322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.183036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.183317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.183594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.184328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:19.184637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.186420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31ba080-5fcf-4674-ad39-11dcd64f0f12 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.200397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 270/537] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:19.201726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9722eb-4204-426a-b88c-e65a9f004210 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.202011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9722eb-4204-426a-b88c-e65a9f004210 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.202311 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9722eb-4204-426a-b88c-e65a9f004210 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.203916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 271/538] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:19.209732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.210263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.210682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.235593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:19.238173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:19.249985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de757d-55dc-4d29-bfa2-5a0861a7e6bb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.296964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.297679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.297964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.298271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.299550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=d8fcad6f0eae4e41891963dfd5b05042) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:19.299867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.302137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.309937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 268/539] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/role_assignments?user.id=d8fcad6f0eae4e41891963dfd5b05042&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:19.310831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.338735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 272/540] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:19.375439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.376480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.440783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48969d78-76db-4516-be5e-505d8247ce06 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.475931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.483159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.483979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.484259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.484530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.493626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.495214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:19.512156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:19.513141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:19.514308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 269/541] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:19.523168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.614505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361e025d-cca9-4021-bdb1-a1401edb57d4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.641325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f320da-2c8d-4388-9d1a-e3843779d496 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.644885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.682166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.683603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.684121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.684715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.686679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.687391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.687693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.688081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.688786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:19.689097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.690683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.699407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:19.705013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 270/542] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:19.708590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:19.709496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:19.710875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:19.713780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 273/543] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:19.714786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.720140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.834946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:19.844587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d124b-5e38-4623-9db9-bc54b731c240 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:19.898768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:19.899850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:19.900349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:19.900837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:19.901968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:19.902563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:19.904258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:19.913624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 274/544] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:19.918659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:19.965998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b960a6-db71-4702-bb4c-bf8afba2bc40 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.028148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe4506-9945-4efd-9129-37263d0df8e6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.051574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.052283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.052563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.052837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.053688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=c697d2c7a55047eaaad9dadab5b8e416) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:20.054036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:20.055574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:20.068029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.069238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 271/545] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/role_assignments?user.id=c697d2c7a55047eaaad9dadab5b8e416&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:20.069861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.070523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.071052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.085848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:20.087801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:20.108423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:20.109369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:20.110284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:20.110284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:20.110284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:20.110284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:20.112855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 275/546] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:20.119311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:20.187498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:20.293100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55260681-6cf0-4c7c-af7e-2022ce9a2400 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.328922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.330033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.330564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.331049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.332022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:20.332542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:20.334176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:20.348189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 272/547] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:20.356776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:20.370906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:20.465661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71532168-3ae4-47e8-a653-49e0ef80bdc5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.501349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.502189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.502474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.502743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.512423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:20.513934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b10c5d77-a071-489d-b991-2c4eace7193e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:20.529649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:20.531154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:20.532239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 276/548] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:20.540972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:20.622985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2eeb9-9f5a-4ed5-9853-fd6e371044b6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.623173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2eeb9-9f5a-4ed5-9853-fd6e371044b6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.623430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2eeb9-9f5a-4ed5-9853-fd6e371044b6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.625090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 277/549] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:22:20.631217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.631513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.631769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.657223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:20.660027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:20.678414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:20.708005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578a8a-4bf8-4b8b-ab77-ac1097ed6732 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.778183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.779285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.779772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.780238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:20.781476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:20.784891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:20.786579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:20.788133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:20.796247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 278/550] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:20.818537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 273/551] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:20.823831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:20.831413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:20.946676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189dbff9-de73-46a8-87e2-39b07e980cf0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:20.994386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:20.995225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:20.995503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:20.995774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.014292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:21.026881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9a9e1-9543-4332-91a4-2a97040dd737 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:21.030735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:21.031781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:21.032609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:21.033719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 274/552] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:21.044843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.057601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.100750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.101412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.101690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.102001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.211857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.224688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.226213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.230429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8766e4-1a3d-463b-8cce-db12a3889aac None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.293549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.294263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.294541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.294812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.295570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:21.295874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.297257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.319813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 275/553] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:21.322023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.418843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.456402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b3f46-db43-453a-8168-77a55fb85f63 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.465616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 279/554] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 642 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:21.475158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.492868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.493821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.494015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.494433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.505623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.507134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:21.524978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:21.525905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:21.526843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:21.526843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:21.526843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:21.526843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:21.526843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 276/555] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:21.532203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.643679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09242692-32f6-40e2-8e6e-11717612d4f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.644566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.651289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da32eca-681a-4f4d-b904-593a192dbf59 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.667594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.684330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.685197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.685487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.685767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.686536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:21.686885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.688339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9812a2a0-4fd5-46c9-b1c9-00f878140da7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.693064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.693873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.694182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.694451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.702386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 277/556] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:21.703762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e363-bd62-451f-89b7-da63357af9ba None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.704113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e363-bd62-451f-89b7-da63357af9ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.704396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9e363-bd62-451f-89b7-da63357af9ba None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.710138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 278/557] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:21.710997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e363-bd62-451f-89b7-da63357af9ba None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.712449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.714281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e198a5c2-360e-4439-86cd-eb1bd9b101a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:21.737273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:21.738836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:21.739906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:21.739906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:21.739906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:21.739906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:21.739906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 280/558] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:21.743829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.743829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.743829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.762231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:21.763696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:21.837734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9e363-bd62-451f-89b7-da63357af9ba None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:21.857986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 281/559] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:21.867612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.887504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:21.888568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:21.890267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:21.890725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:21.905645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:21.908019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:21.929134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:21.931469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 279/560] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:21.933603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:21.979235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:21.987642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.023867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6d658-e748-4493-8acc-9b1a17d86a10 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.045565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa38271-45ba-4c3f-a7e6-0643b881c993 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.070702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.071633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.071633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.071894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.072609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.072917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.074341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.083677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.084575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.084917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.085214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.087247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 282/561] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.088084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.101050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-11353fa8-c3e5-4ee2-a65e-c21d64c3112c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:22.109633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:22.110990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:22.111872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:22.115000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 280/562] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:22.116489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284135-69d4-4f17-9b00-88c5a5b84249 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.116843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284135-69d4-4f17-9b00-88c5a5b84249 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.117184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29284135-69d4-4f17-9b00-88c5a5b84249 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.118845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 281/563] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:22.119688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284135-69d4-4f17-9b00-88c5a5b84249 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.198254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec4d72-ac70-4436-8774-31745d100d3a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.238025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.238935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.239324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.239602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.240459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.240763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.242275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f4e5c-d187-40ea-9244-a204e143b4e9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.246613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.259194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.265728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29284135-69d4-4f17-9b00-88c5a5b84249 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.270722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 283/564] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.272791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.272791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.273007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.291421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:22.292865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:22.310904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.311710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.311992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.312266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.319450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.320940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:22.336771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:22.337772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 282/565] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:22.339314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.370355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 284/566] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:22.380162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.446820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5af91-9cc4-464b-8aa7-d1b0292a9533 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.482986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.483657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.483933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.484204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.484948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.485251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.487497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.495661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 283/567] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.496395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.498261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311bf310-29e7-4816-b3ae-07f337345231 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.521961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.523439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.535085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.536155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.536543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.536935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.548074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.549542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:22.567269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:22.568299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 285/568] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:22.569816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.601993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450f566-f1d3-4de5-b671-34434b860dce None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.635623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.636286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.636579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.636855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.637644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.637959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.639444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dc041-c776-4685-9b03-aac42a0d2966 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.651716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 284/569] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.653117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a34-0066-4388-bf6d-e5c95b8a464a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.653439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a34-0066-4388-bf6d-e5c95b8a464a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.653715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c9a34-0066-4388-bf6d-e5c95b8a464a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.657028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 285/570] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:22.657028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9a34-0066-4388-bf6d-e5c95b8a464a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.671527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220950b3-3c22-4cce-b25c-c435af069929 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.706882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.707792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.708072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.708350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.718764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:22.726680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:22.727642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:22.728839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 286/571] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:22.729530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.746625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.765754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c9a34-0066-4388-bf6d-e5c95b8a464a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.767188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.802023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.802839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.803115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.803381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.813207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.814691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:22.832241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:22.838223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:22.839215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:22.839215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:22.839215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:22.839215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:22.839452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab7bef-07cc-43e7-82ef-03d581509489 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.839530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 286/572] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:22.839530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.869405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.870101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.870387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.870661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.871389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.871695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.873109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d6780-0fcb-478f-9027-3582b0809a87 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.885321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 287/573] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.886848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.887062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.887448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.904465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:22.905689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:22.941615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302c5596-3f0b-4de3-a880-106cf0956ecc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:22.973858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 288/574] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:22.974774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:22.976345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:22.977008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:22.977282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:22.977554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:22.978768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=965fa890ec864b0c870bba47db2f7ffb) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:22.979098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:22.980537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:22.982475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:22.993349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 287/575] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/role_assignments?user.id=965fa890ec864b0c870bba47db2f7ffb&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:22.994514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.012111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.103601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ff9ed8-2d63-4f46-ae23-97d7f9cebcd6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.122302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49599289-4959-420e-b7ce-cd099a467b8f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.153927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.154912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.155198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.156048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.157071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.157186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.158565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.162014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.162728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.163998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.163998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.163998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.164261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.170254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.170431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 289/576] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.170431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.184793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 288/577] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.185980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.261138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.288584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.303984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd73bce-a5d8-4bed-9271-02f7e2a846f5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.305036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1bf9a2-64b4-47b4-9a74-b7b650f9cc5d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.341787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.342355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.342626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.342894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.343165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.343267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.343532 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.343801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.351294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.353293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.357987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:23.366181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:23.367154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:23.367991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:23.368651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:23.369462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 290/578] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:23.371576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.374100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 289/579] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:23.374100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.480060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754017a4-87db-41ff-9304-4ccca21e90e0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.499885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8da560-4c84-4d72-8336-4efb2f13caa7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.520881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.529282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.530268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.530268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.530571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.541410 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.543021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.544124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.545183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.545659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.546130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.553394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.558174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.559834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:23.563793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:23.564696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 291/580] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:23.567308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:23.584462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:23.585489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:23.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:23.587574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 290/581] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:23.588413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.690034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07827ac2-22f2-4a7b-a807-60d0ac33e329 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.707602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640a7e66-21bc-4152-8eb1-689c995a961e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.738460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.739279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.739614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.739900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.740710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.741025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.742574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.757504 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 292/582] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.757504 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.760058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.760764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.761048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.761326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.762213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.762531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.764081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.782343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 291/583] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.782343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.828863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.831011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:23.873762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc78d5-4346-467c-9ee5-daf0ad414f0b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.897698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5065b8-590c-4d93-9974-88610c2d2b33 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:23.917035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.918161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.918584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.919008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.919896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.920343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.922553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.939635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 293/584] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.939868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:23.940864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:23.941008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:23.941390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:23.941862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:23.943457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:23.943977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:23.946597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:23.975664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 292/585] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:23.976665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.080405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff06ae13-2f2c-4ffe-b731-5d2e6c99d39e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.094070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.102336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6d156d-2fdd-440b-9510-7d7823126b66 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.109733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.124738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.125939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.125939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.126167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.137677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.139239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.143854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.145073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.145562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.145874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:24.159645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:24.160755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:24.161654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:24.161654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:24.161654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.161654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:24.161654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 294/586] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:24.161955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.168839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=a43c2cee600846c99e25b81e21726370, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.170331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.186287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 293/587] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:23 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:24.187488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.302826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9038e82-8fff-4eb0-9962-a5c0f640920f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.346018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0095854-d4ed-4643-9110-f7a98de93c3b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.351684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.353319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.353804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.354305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.363231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.365194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:24.384724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:24.385743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:24.386765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:24.387841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 295/588] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:24.388832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.391131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.392246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.392430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.392704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.404468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.405956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.417188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:24.432554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:24.433665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:24.434804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:24.434804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:24.434804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.434804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:24.434804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 294/589] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:24.435089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.441824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.535803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae32b45-0ef0-45a0-b0e4-f5a78208f814 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.552692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1607c3b-aeb5-4a12-9800-02b103c22e64 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.578815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.579481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.579764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.580042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.580767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:24.581072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.582859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.594193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.595236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.595719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.596248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.597350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:24.597912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.599235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 296/590] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:24.599841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.600185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.626498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 295/591] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:24.627978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.692122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.699029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.706291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7ab56-855a-44b4-b1ec-1f43f1e69b79 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.743137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.743842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.744118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.744373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.745097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:24.745405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.746844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.752511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58866616-1fd1-43eb-8f46-a3801b9feacd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.768108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 297/592] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:24.769069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.791499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.792701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.793183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.793746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.802424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.804263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:24.821135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:24.822466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:24.823459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:24.826168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 296/593] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:24.827289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:24.900992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de1021-6db3-4a99-8f39-453dfbdfa191 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.940752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df01cac-b4e5-41f1-bf53-4db9ddf46b7c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:24.946683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.947493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.947769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.948039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.961553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:24.962881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:24.964686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:24.984360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:24.985522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:24.986038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:24.986539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:24.987829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:24.989152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:24.990046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:24.990046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:24.990046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:24.990046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:24.993966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 298/594] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:24.995509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.001255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.003106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.005079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:25.021574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:25.022607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:25.023535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:25.026270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 297/595] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:25.027487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.125165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1bf98-c2eb-4f1a-9a95-99240f0b95e0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.164269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27902f9-5174-48da-b928-5e715b18fdd5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.164786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.165181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.165459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.165732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.166638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:25.166946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.168422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.190104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 299/596] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jun 21 10:22:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:25.190104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.207722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.208399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.208685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.208966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.209696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:25.210007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.211419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36e8231-a746-4190-b88f-fb8f52651f59 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.224703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 298/597] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:25.225863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fa40-e371-4f42-8f20-99817e720c44 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.226178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fa40-e371-4f42-8f20-99817e720c44 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.226461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338fa40-e371-4f42-8f20-99817e720c44 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.228183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 299/598] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:25.232864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338fa40-e371-4f42-8f20-99817e720c44 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.266769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.274750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.309635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d208e-c7a7-4249-8843-1bddf68e3baf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.346138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.346474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338fa40-e371-4f42-8f20-99817e720c44 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.346962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.347356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.347695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.348822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:25.350007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.351595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.365461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 300/599] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:25.366718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.390825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.391627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.391908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.392185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.403047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.404544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a3e17e8a-f878-49d5-88f5-c7b9d739b3be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:25.428010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:25.429124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 300/600] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.435313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.450176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:25.451362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:25.504669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd4a984-53ea-462f-adb7-9b6c8c96be2b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.528147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 301/601] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:25.529250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.536015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.550419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.551608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.552175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.552699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.557175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.561228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.562911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:25.578211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:25.579337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:25.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:25.586835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 301/602] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:25.587898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.645748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2631de-f2ef-43d6-bbc7-b02ec3cea6ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.685890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.686798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.687075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.687392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ee05ef1224e94100b841074a1ea6727c/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.695628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f82e2a-1917-45a1-82b7-0618624f950a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.703698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=ee05ef1224e94100b841074a1ea6727c, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.705153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.726092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 302/603] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:25 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ee05ef1224e94100b841074a1ea6727c/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:25.726092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.741471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.742418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.742802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.743222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.744103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:25.744560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.746179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.765018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 302/604] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:25.765018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.818346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.850459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:25.864220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52870194-ff00-4f94-b67c-73e2fde41dae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.898822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77126f-6640-4aec-9f28-43513a5da3e3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:25.908832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.909931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.910430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.910833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.933609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:25.943168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:25.944344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:25.945203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 303/605] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:25.945903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:25.951049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:25.951727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:25.952012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:25.952283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:25.953082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:25.953393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:25.954930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:25.967945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 303/606] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:25.970268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.060868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e7be0-e753-4b0c-8d8b-6a4ec7b2fb58 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.090609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.099888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.100619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.100903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.101175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.107452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b83d-4e7c-4baa-91ca-bbd3a954db12 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.109008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.110546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.110969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:26.129222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:26.130231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:26.131122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:26.135701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 304/607] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:26.136658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.155385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.156968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.157797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.158432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.159405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:26.159959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.162621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.180296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 304/608] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:26.180296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.254636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b77937-ea13-47f4-ae35-ac20b878768f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.295784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.296795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.297170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.297542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/d8fcad6f0eae4e41891963dfd5b05042/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.313138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=d8fcad6f0eae4e41891963dfd5b05042, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.314967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.323563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe97ba-afaa-4def-857c-40bdbd63f655 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.338084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 305/609] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:26 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/d8fcad6f0eae4e41891963dfd5b05042/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:26.338084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.386010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.392594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.393297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.393569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.393847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.399728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:26.399728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.399728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafc6351-a075-4724-897b-6b4a3c009311 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.414909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 305/610] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:26.416719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c373a4-aced-4124-8e69-8eb25faf49f0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.417411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c373a4-aced-4124-8e69-8eb25faf49f0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.417691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c373a4-aced-4124-8e69-8eb25faf49f0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.419562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 306/611] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:26.421291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c373a4-aced-4124-8e69-8eb25faf49f0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.457411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.466327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74447d03-2edd-4917-8d3f-38f7b0cb73ec None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.507632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.508551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.509001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.509376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.523646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.525437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-99a3907c-7dce-416f-8233-ffa13d45ee9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:26.546277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:26.547379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:26.548429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:26.548429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:26.548429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:26.548429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:26.549400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 306/612] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:26.555271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.555557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.555838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.565858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c373a4-aced-4124-8e69-8eb25faf49f0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.577576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:26.578817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:26.616518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.617423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.617783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.618022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/c697d2c7a55047eaaad9dadab5b8e416/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.634737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=c697d2c7a55047eaaad9dadab5b8e416, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.636213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.654741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 307/613] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:26 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/c697d2c7a55047eaaad9dadab5b8e416/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:26.655667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.676105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 307/614] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:26.729495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.764136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.792918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:26.845588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7ebec-2865-499d-bfe8-3456431ce476 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.914741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.915484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.915767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.916042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.916788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:26.917096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:26.917199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaf5ebc-708a-4533-b9e1-5c16eb4c895a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:26.918599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:26.932780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 308/615] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:26.939205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:26.964210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:26.965045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:26.965323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:26.965604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:26.980192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:26.989427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:26.990433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:26.991299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:26.995936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 308/616] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:26.998233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.118528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c5725-b738-47d4-bd1e-177f28489e95 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.145085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:27.166317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a1fb4-6ba6-4c23-bfa8-e591a4ac18ca None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.191679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.192553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.192842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.193118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.198231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:27.204010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.205755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.211298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.211979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.212257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.212529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.213284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:27.213587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.214989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:27.221015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:27.223262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:27.225430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 309/617] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:27.235591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.238041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 309/618] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:27.250010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.361328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd106-3bc2-43e4-949c-b30e56855aa1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.405706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.406345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.406627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.406909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.407812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:27.408131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.409637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.416643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5cf0fc-82c1-44f4-8b00-37e44485f432 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.428967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 310/619] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:27.439082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.460602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.461419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.461698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.461970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.473412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.474917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.478571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:27.495334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:27.496283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:27.497769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:27.497769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:27.497769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:27.497769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:27.501965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 310/620] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:27.503232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.610324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf60908-bce5-4662-a7fb-ebbbb6100f7b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.630432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:27.647770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.648791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.649076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.649357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.650114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:27.650429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.651993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.670097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 311/621] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:27.671373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.734483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:27.781422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f2e12-9aec-49ef-b2a1-242e9e65a3f6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.781955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40601a3-5eb2-43e8-b53e-e540bd57c2d5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:27.819479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.820285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.820565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.820838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.837887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.839397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:27.864143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:27.865181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:27.866167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 312/622] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:27.873297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:27.874132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:27.874416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:27.874688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:27.882952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:27.890599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:27.892081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:27.919032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:27.920012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:27.920956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:27.920956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:27.920956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:27.920956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:27.920956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 311/623] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 482 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:27.925950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.041998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979c36e-1fd7-4a9a-9e10-db1346c96554 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.051320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.075399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40eb4fe-9f24-4660-900c-37ccec692a0f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.086101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.086820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.087102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.087376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.088595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:28.088907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.090816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8057b325-d971-49ce-9895-0e042ee62140 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.098680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.106894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 312/624] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:28.108265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721258-0925-4069-b544-67ed02c6fc19 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.108556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721258-0925-4069-b544-67ed02c6fc19 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.108837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01721258-0925-4069-b544-67ed02c6fc19 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.110353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 313/625] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:28.115792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.116371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.116778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.127713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.128403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.128976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.129275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.130178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:28.130548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.132136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.139750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:28.141222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:28.159419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 313/626] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:28.159419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.247362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 314/627] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:28.249031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.318871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428b8438-2a13-4a94-bd5e-7bd8af42cf51 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.363704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.364612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.365908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.366767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.367214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.371114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657487f-b64b-40ba-b796-5655e7d923ec None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.380854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.382529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:28.397685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:28.398817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:28.399810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:28.403861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 314/628] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:28.404846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.414853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.415725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.415834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.416059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.444015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.493854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.495709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.517857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a35df4-56b7-48ba-9cf3-da35712afcc8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.555313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.556414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.556843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.557301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.569738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:28.577878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:28.578822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:28.579673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:28.582785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 315/629] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:28.583815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.625319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.634883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 315/630] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:28.636098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.703873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.714741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f502d9-71f4-4da4-bfff-b54ff35577ea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.744632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324ffdb-7406-407b-b7a1-139e884e5d92 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.750849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.751517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.751800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.752116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.752908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:28.753216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.754786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.774107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 316/631] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:28.774892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.781026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.781712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.781989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.782307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.783241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:28.783560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.785040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a0bbd3-e6fd-436a-8de4-3155d9f43b92 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.794394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 316/632] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:28.795821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e661773-0fbb-458a-bfd8-dfcbe5a799a3 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.796109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e661773-0fbb-458a-bfd8-dfcbe5a799a3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.796384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e661773-0fbb-458a-bfd8-dfcbe5a799a3 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.801959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 317/633] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:28.801959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e661773-0fbb-458a-bfd8-dfcbe5a799a3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:28.865384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.890346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a2e5c-d58f-402d-9fe5-bbcbdea8e919 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.912150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e661773-0fbb-458a-bfd8-dfcbe5a799a3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:28.928479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.929292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.929574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.929859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.941285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.942890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.947329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:28.948512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.949007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.949487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/965fa890ec864b0c870bba47db2f7ffb/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bda40731-25f2-4a1f-9c2a-4d1f2d222215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:28.961311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:28.962361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:28.963246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:28.963246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:28.963246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:28.963246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:28.967231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 317/634] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:28.967360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=965fa890ec864b0c870bba47db2f7ffb, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:28.968609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:28.968801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:28.968916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:28.969350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:28.978967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:28.985137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 318/635] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:28 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/965fa890ec864b0c870bba47db2f7ffb/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:28.992639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:28.993879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:28.999080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.110605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 318/636] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:29.111675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.128583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7370cb6-8d8e-426c-b287-b07727be5438 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.142708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.181919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.183145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.183145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.183367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.198108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.199578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-489a5471-4d5b-4136-8325-8743d276ee80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:29.219285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:29.220816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:29.221755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:29.221755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:29.221755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:29.221755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:29.221755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 319/637] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:29.222638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830666f-7ae6-4086-8b83-56f9e26f233e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.222638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830666f-7ae6-4086-8b83-56f9e26f233e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.222638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830666f-7ae6-4086-8b83-56f9e26f233e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.228323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 320/638] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:29.228323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830666f-7ae6-4086-8b83-56f9e26f233e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.248811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4279535-9335-413b-b889-ab9db89c9531 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.295626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.296572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.296851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.297123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.297851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:29.298185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.300237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.303043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.319267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 319/639] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:29.320955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.336454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830666f-7ae6-4086-8b83-56f9e26f233e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.374613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.375336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.375619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.375890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.388106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b5b03473-74f3-4631-bc8e-2c396dd14934 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:29.395940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:29.397113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 321/640] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:29.402783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.403548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.403548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.420375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:29.422281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:29.440546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.452589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51461af1-8bec-4fc1-8bb5-394fbb87a8c7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.491701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.492814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.493101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.493543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.494631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:29.494950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.496344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.504493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 322/641] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:29.505645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.513550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 320/642] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:29.513550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.584513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.628868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a7218-6dd4-4519-b58d-e9dd909922e4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.635366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb606b7-e927-44b5-9705-158b6ffe60c8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.664921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.665750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.666085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.666392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.674338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.674635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.675442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.675890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.675987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.676250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.677010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:29.677324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.678725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.688620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 321/643] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:29.689468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:29.692488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:29.693448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:29.694392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:29.698436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 323/644] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:29.699381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.713163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.821276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3967936f-5dc9-40fc-b7f6-b6ead6d1c0f3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.831452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd12123-c63e-4b1e-8d66-0c9c50b1715d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:29.853901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:29.862737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.864025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.864458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.864881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.875229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:29.876062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:29.876342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:29.876615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] PATH_INFO: `/v3/users/glance` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:29.879103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:29.886497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:29.886968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:29.887932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:29.895462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:29.896131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:29.896207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 324/645] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:29.896207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:29.912738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:29.913805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:29.915152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 322/646] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:29.915764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:29.980010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.014713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864bdab-c9c5-4038-89e3-ef154df8306b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.038954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39e263-9725-487d-b3de-474ab12eefaa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.053788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.054654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.054933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.055211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.067035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.068626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.076993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.078114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.078584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.079039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.080116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:30.080615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.082739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:30.087446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:30.088448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 325/647] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:30.094659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.108007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 323/648] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:30.108007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.145971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.212175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd4552-1aa3-49ae-aaa8-efb8dd9bc193 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.223142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568529a5-ab90-4339-875b-97ea92aec24d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.237606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.251912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.252668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.252952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.253248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.254315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:30.254712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.256228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.269314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 326/649] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:30.270496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.278175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.279158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.279574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.279819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.280795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:30.281106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.282623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.306793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 324/650] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:30.310186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.400251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1a6d3-40b8-4ef3-b37a-6098f00bd899 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.418912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.427898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122e76bd-d555-4390-be69-8c073f4d7a89 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.434754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.435427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.435708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.435985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.436708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:30.437012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.438439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.454829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 327/651] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:30.454829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.470616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.471377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.471681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.471958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.473196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:30.473528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.475023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.490081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 325/652] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:30.490081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.511925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.586668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a7f27-5ac7-4b1d-b645-e0cb63a2b0f2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.628670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.629593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.629946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.630325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.642369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.644000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.646911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e2341-64e6-473d-b04f-56deede6be3b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:30.663891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:30.664836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:30.665720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:30.665720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:30.665720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:30.665720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:30.670236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 328/653] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:30.671040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.698106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.699115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.699667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.699667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.734273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.795756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.798395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.803336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378fbaf9-24e6-4503-b546-d395fb06a9c1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:30.807362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:30.855142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:30.856503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:30.856952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:30.857634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:30.868454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:30.870457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:30.891361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:30.892538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:22:30.893883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:30.900923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 329/654] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:30.900923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:30.942176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 326/655] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:30.942176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.022426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.030832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c576b-903c-4a50-a6e2-3d6708922744 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.051696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1da5b-f66a-41fc-b14f-c9488594d3ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.079978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.081649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.083791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.084500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.085368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:31.085793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.088010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.096233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.096866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.097496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.097830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.098726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:31.099044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.100645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.105301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 330/656] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:31.106414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.124867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 327/657] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jun 21 10:22:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:31.125718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.135056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.225178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea81fc-0bd4-4bf0-aa88-db81055be880 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.234244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec23eab-fcb8-4810-b891-a28f1fa02d33 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.253689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.267298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.268129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.268400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.268675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.282474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.284187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.285444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.286314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.286665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.286866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.295738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.297229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-930048af-fc49-4832-9172-5a1e3d347167 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:31.304265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:31.305349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:31.306404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:31.306404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:31.306404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:31.306404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:31.306922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 331/658] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:31.308234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9877-7acc-469c-b19d-40f8a7ded808 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.308615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9877-7acc-469c-b19d-40f8a7ded808 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.308849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256c9877-7acc-469c-b19d-40f8a7ded808 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.310265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 332/659] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:31.314218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c9877-7acc-469c-b19d-40f8a7ded808 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:31.322629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:31.323812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 21 10:22:31.324851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:31.331221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 328/660] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:31.331952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.389050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.429777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256c9877-7acc-469c-b19d-40f8a7ded808 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.441061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eaa7c2-67c3-4926-9442-b6718e35b7f0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.464007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.464723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.465006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.465282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.487488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.488188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.488473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.488753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.489483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:31.489816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.491445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e820ba35-a071-4b4a-8f60-4df0f8f8381a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.508208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 329/661] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:31.508208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.508208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.508208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.522732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:31.524058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:31.540336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.541831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.554343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.602283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 330/662] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:31.602283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.615371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.655594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 333/663] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:31.656462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.723718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a99cc78-7e06-42aa-9041-675b0ce17866 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.763358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.763919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.764225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.764485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.764585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59b4c1-0d5f-4cfb-8c22-fb4497f6f906 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.765337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:31.765649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.767190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.786111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 331/664] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:31.791434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.801940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.802899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.803183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.803694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.810582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.812058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:31.819805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:31.827887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:31.828840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:31.829734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:31.833857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 334/665] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:31.834714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.865688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:31.902217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb29e1e-4d59-40bb-b106-bc6261d9d355 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.939853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.940658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.941028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.941243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.942720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ac184c-ef5f-4655-85f4-9c70cf862b24 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:31.951795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:31.959592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:31.960726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:31.961766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:31.965687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 332/666] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:31.966534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:31.981867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:31.983010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:31.983292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:31.983571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:31.994992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:31.996474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:32.015544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:32.016438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:32.017345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:32.017345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:32.017345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.017345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:32.017345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 335/667] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:32.018150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.064445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.084542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d973f69-0591-49bb-b1c0-7acd20f29ff6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.106968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.122588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.123311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.123598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.123877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.128948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7a9239-0866-4b49-916f-410e651025a2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.163729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.164487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.164835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.165168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.166025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:32.166376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.167851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.181002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 336/668] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:32.181846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.201810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.203344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.296702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af9a66-5634-4008-bdfe-2b0a6f2eb9bd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.305253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.327263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 333/669] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:32.328503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.342810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.343498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.343781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.344056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.344812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:32.345121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.346571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.361913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 337/670] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:32.361913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.361913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.443753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39c598-3418-4ab6-abc5-1937890be42d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.479887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0903ee-0a99-4757-8d63-852a49fe1ea2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.482831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.483499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.483773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.484041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.484761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:32.485065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.486480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.501802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 334/671] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:32.504415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.518447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.519242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.519606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.519935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.521142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ee05ef1224e94100b841074a1ea6727c) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:32.521464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.523025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.529349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 338/672] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/role_assignments?user.id=ee05ef1224e94100b841074a1ea6727c&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:32.530200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.572208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.634508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.643152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17f40d-0616-4191-bbd6-ac19b74bbef4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.683138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.683928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.684235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.684478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.686982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b624f-1b76-422f-a4fd-b9f946bf9fd6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.697545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.699123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:32.718383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:32.719604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:32.720684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:32.720684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:32.720684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.720684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:32.720684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 335/673] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:32.721030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.734946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.736508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.736789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.737064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.750835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.753616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e6fa91d3-bf36-4d56-8857-28e695cb5bb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:32.775132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:32.776079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:32.776958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:32.776958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:32.776958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:32.776958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:32.776958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 339/674] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:32.777672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd9e7-56ba-4ffb-a352-eeab752ffef0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.777952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd9e7-56ba-4ffb-a352-eeab752ffef0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.778289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bd9e7-56ba-4ffb-a352-eeab752ffef0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.779725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 340/675] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:32.780322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd9e7-56ba-4ffb-a352-eeab752ffef0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.840793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.848312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d2ea1-693a-45db-95d8-2353b85182f9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.884477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.885279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.885567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.885841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.892931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.895120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.899959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bd9e7-56ba-4ffb-a352-eeab752ffef0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:32.909248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:32.910334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:32.911382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:32.914194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 336/676] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:32.915189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:32.922354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:32.942310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:32.942975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.943252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.943555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.944333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:32.944549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:32.945965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f77a04-8aa8-47e7-a82a-1b6c3ba95a04 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:32.963562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 341/677] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:32.963562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:32.963562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:32.963562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:32.979554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:32.980755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:33.033291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9297e7e8-5f45-4a8d-8199-a150afea3688 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.054104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 342/678] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:33.054104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.074668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.075874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.076163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.076724 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.077509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.077817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.079298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.091954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 337/679] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.096635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.120341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.173907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1f359-fff1-42f9-8a08-3e5a93bd3284 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.184058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.210624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1f239-f448-4141-89fd-d99d7d7c7698 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.212055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.212722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.212998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.213272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.214066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.214382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.215861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.228851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 343/680] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.229686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.262882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.263811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.264245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.264516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.275177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.276781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:33.291635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:33.292554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:33.293438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:33.297558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 338/681] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:33.298453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.339554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d6960-2fc1-4399-926c-314bee20706f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.383931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.392726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.394227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.394738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.395240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.411732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70bdf7-ae19-4108-99e9-fa906a70f14b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.413251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:33.429227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:33.430409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 344/682] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:33.436449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.465867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.466759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.467042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.467309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.475584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.476530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.477055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:33.493475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:33.494767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:33.495723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:33.498446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 339/683] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:33.499767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.576932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ab8c6-55dd-4aa0-a6b4-3295dea2ff74 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.616859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.617527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.617808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.618419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.618961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=d8fcad6f0eae4e41891963dfd5b05042) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.619274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.620778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.624805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5c74f-c46e-4bda-9db2-a068169df2e6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.627777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 345/684] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/role_assignments?user.id=d8fcad6f0eae4e41891963dfd5b05042&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.628671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.687250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.688304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.688773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.689745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.692336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.692937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.695607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.706242 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.714950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 340/685] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.716149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.759682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:33.774135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a558-84c1-4e7f-bfcc-70de89121f55 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.812821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.813582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.813864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.814176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.814967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.815268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.817000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.830307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 346/686] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.831185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.876270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18896bc2-649d-41b4-b796-4a40fed3abc4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:33.920171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:33.920851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:33.921135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:33.921410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:33.922290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:33.922801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:33.925336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:33.947299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 341/687] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:33.948172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:33.972563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac91a65-af88-443b-9cef-0996102630a9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.014671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.024078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.025021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.025511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.025962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.027270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=c697d2c7a55047eaaad9dadab5b8e416) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:34.028386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.030349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.039851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 347/688] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/role_assignments?user.id=c697d2c7a55047eaaad9dadab5b8e416&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:34.040993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.066758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.101360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3f06-6014-4d76-bc31-b6065760f5d7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.187356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.188566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.190258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.194320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.211163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.212976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:34.236230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:34.237229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:34.238467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:34.238467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:34.238467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:34.238467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:34.238692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d9259e-20aa-47f5-9664-d55db7180838 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.241016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 342/689] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:34.246584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.303819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.304935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.305466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.305954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.360071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc186c9-be63-455e-bdd6-e12e9bacfce9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.368516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.384512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.386733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.400231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.400852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.401140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.401417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.402174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:34.402484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.403998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.408630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.420595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 343/690] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:34.426692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.513656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 348/691] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:34.519775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.564223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27386279-a7a5-49c1-bfb0-b96fb9fa5b0f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.644447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe3e40-e8e3-4c9c-b42a-eb3081d8f817 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.654782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.656138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.656594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.657016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.665112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.678498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.680119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.686119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.687258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.687740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.688211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.702587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.704467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:34.723094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:34.724124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:34.725098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 344/692] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:34.728450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:34.729328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:34.730239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:34.730239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:34.730239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:34.730239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:34.730476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.732593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 349/693] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:34.748145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.775106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:34.877134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eddafda-27bb-448c-92d4-161f172147af None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.879925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1fd15a-b873-40c9-9b94-2304f257fbb8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:34.919946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.920488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.920770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.921040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.921968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:34.922329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.923844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d26ae6-6d65-4930-9835-ec165f62a8f7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.929903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:34.930923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.931574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.932156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.933353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:34.933885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:34.935633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:34.945560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 345/694] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:34.947365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496819-2c59-4342-87d3-8f1b73eb5e9f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:34.947861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496819-2c59-4342-87d3-8f1b73eb5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:34.948254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 350/695] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:34.948566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb496819-2c59-4342-87d3-8f1b73eb5e9f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:34.950338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 346/696] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:34.954676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:34.954989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496819-2c59-4342-87d3-8f1b73eb5e9f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.015432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.072457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.084736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a47cf-8a68-4652-a10d-70af3be1890d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.097689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb496819-2c59-4342-87d3-8f1b73eb5e9f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.125784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.127043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.127781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.128256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.136548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.137479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.137836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.138203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.145862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.147372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-84f34fd0-89ea-4473-a6d0-e9cb1a543119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:35.161896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:35.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:35.163830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 347/697] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:35.165415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.165653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.166020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.183916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:35.185172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:35.221452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.223511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.270078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.270305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 348/698] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:35.270305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.363158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 351/699] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:35.364465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.404235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.438670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881509fa-85d2-4fff-ab84-e18296aad6b1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.474204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.474890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.475232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.475442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.476240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:35.476549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.478395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.491235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 349/700] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:35.492216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.498770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4ca60-89a0-43dd-9d13-abf07c867c0f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.538428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.545210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.546509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.546992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.547608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.560346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.562042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:35.591516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:35.592711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:35.593839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:35.593839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:35.593839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:35.593839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:35.600224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 352/701] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:35.600224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.623669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0089e2d-7abe-41a3-908a-d1fef277d1ea None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.662002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.663314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.663549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.663920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.666409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.677746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.679463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:35.700020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:35.701143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:35.702485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:35.702485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:35.702485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:35.702485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:35.707039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 350/702] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:35.708049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.748331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6144c566-c5a0-4a16-a1b2-aa85933feb5f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.788836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.789828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.790329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.790801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.791836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=965fa890ec864b0c870bba47db2f7ffb) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:35.792345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.794027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.802266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 353/703] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/role_assignments?user.id=965fa890ec864b0c870bba47db2f7ffb&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:35.803669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.833603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7dbb09-3741-4f3b-9d65-db0f798300f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.860292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.877582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.878598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.879057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.879574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.880703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:35.881277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.882941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.897750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 351/704] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:35.904115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:35.925572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80278960-610e-4a2f-b274-defb17679ed4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:35.971559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:35.980105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:35.981343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:35.981343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:35.981535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:35.982259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:35.982630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:35.984122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:35.998353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 354/705] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:36.007235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.044466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2a926-3f52-48ea-b7f9-8bf3746d655f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.085192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.085892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.086261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.086553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.087261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.088792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56eb6a-a26e-4007-8fd4-f0a277db7362 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.116450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 352/706] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:22:35 2022] POST /identity/v3/users => generated 254 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:22:36.117813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5f70-bd10-4d18-91a6-da7bc37dc73d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.118663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5f70-bd10-4d18-91a6-da7bc37dc73d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.118663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5f70-bd10-4d18-91a6-da7bc37dc73d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.124028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 353/707] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:36.128146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.128886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.129311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.150992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:36.152821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:36.156014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a98c8-7234-48dd-81fc-ff1fb6c6752b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.165176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:36.200605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.201551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.201770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.202073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.211211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.212775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:36.235248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:36.236181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:36.237068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 355/708] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:36.242296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.250679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 354/709] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:36.283951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.324738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:36.367508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3c6c-8101-4809-a60f-f98e0b55041b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.408198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.408878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.409158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.409436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.410382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:36.410679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.412174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.429609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 356/710] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:36.430193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce2294-0f39-4512-8b2d-3316201766ae None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.431043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.468601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:36.469415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.470604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.471090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.471562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.472649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.474383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:36.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:36.491326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:36.492201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:36.495274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 355/711] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:36.503205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.541341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8f8d44-c9cb-458c-8757-c620f4340da4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.578414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.579455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.579455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.579728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.580556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:36.580871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.590117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5b38-a461-48d7-b394-b9336b8618c3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.594216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 357/712] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:36.637661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0897ab-38e6-49d9-bb36-19780dde44a6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.637979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0897ab-38e6-49d9-bb36-19780dde44a6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.638245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0897ab-38e6-49d9-bb36-19780dde44a6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.643921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 358/713] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:36.647600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.647902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.648156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.675678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:36.680849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887fdc5-7773-48ae-8eef-e120f8710f9b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.683266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:36.684924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:36.719871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.721094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.721643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:36.722261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:36.723247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:36.723758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:36.725392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:36.731811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 356/714] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:36.743239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.782623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 359/715] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:36.822564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:36.842446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:36.925240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964bcdb6-687c-428d-bbb8-3d424bb978f0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:36.998926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:36.999528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:36.999813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:37.000086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:37.000823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:37.001122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:37.002569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:37.015450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 357/716] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:37.018429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b28aa-8d63-4811-891f-a4b3c9fbccec None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:37.074906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:37.075892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:37.076172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:37.076447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:37.077163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:37.078850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:37.097432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:37.098582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:37.099449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 360/717] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:36 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:37.105292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:37.141729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:37.241508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38343bbc-b543-46c4-bfe5-b70ddfffd000 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:37.280305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:37.281259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:37.281706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:37.282183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:37.283103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:37.283577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:37.285571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb05f14-f440-44bc-917a-34df9865c92c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:37.291625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 358/718] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:37.297413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:37.398471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:37.418672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06db8deb-2b53-47f6-a68d-d55d3253700d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:37.470845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:37.471518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:37.471798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:37.472084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:37.473361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] RBAC: Adding query filter params (type=network) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:37.473797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:37.475303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c936e8f-db36-4ea3-9524-6b07a6dd6819 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:37.489932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 361/719] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:37 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:38.551748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f60-bc4b-4ae7-8783-c0a04c739286 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:38.552320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f60-bc4b-4ae7-8783-c0a04c739286 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:38.552320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09805f60-bc4b-4ae7-8783-c0a04c739286 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:38.554081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 359/720] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:38.564549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59381-fbb2-419d-b0d0-b45d056afaca None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:38.565077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59381-fbb2-419d-b0d0-b45d056afaca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:38.565077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e59381-fbb2-419d-b0d0-b45d056afaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:38.595182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-72e59381-fbb2-419d-b0d0-b45d056afaca None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:38.596764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-72e59381-fbb2-419d-b0d0-b45d056afaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:38.692630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 362/721] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:38.733007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805f60-bc4b-4ae7-8783-c0a04c739286 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:38.837588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66046c6-2a2a-4445-a32a-07c28725c776 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:38.838272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66046c6-2a2a-4445-a32a-07c28725c776 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:38.838757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66046c6-2a2a-4445-a32a-07c28725c776 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:38.840920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 363/722] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:38.846819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:38.847482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:38.847988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:38.867057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:38.868788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:38.875485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:38.921189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09805f60-bc4b-4ae7-8783-c0a04c739286 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.040862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.042871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.043664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.044375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.068572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 364/723] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 21 10:22:39.069626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:39.088291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:39.090023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:39.091675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:39.097506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 360/724] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:39.104181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.122386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.136427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:39.327320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025ee35-1085-486b-841f-e39fae4dd2eb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.342675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31979c94-c9f7-49f5-b646-363d0e20e8f1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.369208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.370069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.370473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.370870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.371854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:39.372266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:39.373925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6e1a70-da67-4bea-a9e5-eb4128b0ae58 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:39.381758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.382911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.383398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.383847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.390840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 365/725] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:39.393260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a31-e97c-4b30-8522-4f833f5ac4d1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.393959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a31-e97c-4b30-8522-4f833f5ac4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.394640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3a31-e97c-4b30-8522-4f833f5ac4d1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.400776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 366/726] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:39.400776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3a31-e97c-4b30-8522-4f833f5ac4d1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.402546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0227a407-a262-4f45-9011-6b7fc1fdd7c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:39.410818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:39.411832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:39.412676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:39.415794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 361/727] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:39.417336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.417811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.418276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.436945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:39.438200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:39.440726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:39.513606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 362/728] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:39.514527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.515199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:39.575687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3a31-e97c-4b30-8522-4f833f5ac4d1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.624523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9540597-c529-4ed7-bf26-2a685e9dd225 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.647234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.648992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.649685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.650559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.663102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.663797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.664128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.664408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.665231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:39.665590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:39.667095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:39.673298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:39.684932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 363/729] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:39.684932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.686073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:39.689161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:39.724346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:39.726426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:39.728553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:39.728553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:39.728553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:39.728553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:39.732349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 367/730] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:39.734160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.794607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5033ff1-1c67-4abb-bd7f-22c7433b0a85 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.855715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.857000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.857483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.857967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.866355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5059c4-78cc-4ec6-8e87-e14484ea9195 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:39.878082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:39.893387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:39.895233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:39.896401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:39.897708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:39.897809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 364/731] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:39.901923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.909694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:39.910527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.910812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.911088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.923638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:39.925177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a4ad63fb-9f98-4afc-8fd1-1906c8fe4a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:39.944786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:39.946586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:39.948284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:39.948284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:39.948284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:39.948284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:39.948284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 368/732] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:39.948821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebebf-9fb2-4dfe-ac4f-6a5dd6bc7fb9 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:39.948821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebebf-9fb2-4dfe-ac4f-6a5dd6bc7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:39.949048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276ebebf-9fb2-4dfe-ac4f-6a5dd6bc7fb9 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:39.950705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 369/733] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:39.951215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ebebf-9fb2-4dfe-ac4f-6a5dd6bc7fb9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:39.993046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.046366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490fbbdd-3362-4ed3-a524-150770294649 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.089674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.090361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.090644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.090929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.091667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:40.091992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.093377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.101426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276ebebf-9fb2-4dfe-ac4f-6a5dd6bc7fb9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.117236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 365/734] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:40.117236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.153292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.153883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.154180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.154459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.155224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:40.155530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.156966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f48f51-e724-4f0e-a87f-5b544aa276ca None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.166336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 370/735] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:40.167579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.167870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.168150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.185807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:40.187068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:40.233143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.280372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a1691b-251e-4faa-819c-e3a394d7cefb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.308699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 371/736] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:40.310292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.312042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.337452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.338656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.339156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.339644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.341014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:40.341550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.344289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.358685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 366/737] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:40.359616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.432351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df6e33-a44c-4427-96f5-8cfab357c834 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.468528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.469352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.469627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.469912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.476993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fac5f0-09e6-4313-9b94-9ba9403349fe None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.478208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.479743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ae9f1f4d-1947-4547-8dd2-a1a71123469b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:40.495223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:40.497182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 372/738] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bfe9f-bfb5-4256-8717-6262db124b6f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.499050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bfe9f-bfb5-4256-8717-6262db124b6f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.500376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bfe9f-bfb5-4256-8717-6262db124b6f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.500376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 373/739] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:40.500903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bfe9f-bfb5-4256-8717-6262db124b6f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.516708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.517517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.517803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.518104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.529595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.531076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.534749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:40.549589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:40.551609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 367/740] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:40.552572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.585288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.620006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bfe9f-bfb5-4256-8717-6262db124b6f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.658325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.658970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.659256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.659559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.660387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.661823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.677387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da00d-4f2e-4045-97e4-c30f53678cbc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.680468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 374/741] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:22:40 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:40.681123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.765362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.766795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.767231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.767675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.781773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.784491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.812514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c19447e2-71ae-4af2-9d9e-e98dcad05f88 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:40.817702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:40.818973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:40.819951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:40.821116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 368/742] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:40.825144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.825516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.825962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.838690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176b4f86-e0f4-43f7-a8b5-5e5fb6c5f835 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:40.857339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:40.859912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:40.886477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:40.887176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:40.887447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:40.887725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:40.888575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:40.888883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:40.890398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:40.912142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 375/743] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:40.912999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.954410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 369/744] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:40 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 21 10:22:40.979537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:40.991737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.069450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6292c413-d30d-4a3f-85d1-e4ce0fafe992 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.093960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62902c-21bb-490c-afe0-1967a1f99c8c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.110250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.110924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.111206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.111485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.112223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:41.112546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.114000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.127218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 376/745] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:41.128085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:41.135326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.143846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.144857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.145144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.145431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.146353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:41.146598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.148089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.168379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 370/746] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:41.169231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:41.256967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172aab47-22ad-4052-807b-09a5d36c0bb3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.264047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.298567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249bf50-69ef-46c1-a7ae-36732f2628ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.310681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.311769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.312243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.312725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.349773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.350792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.351214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.351678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.353134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.355373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.377342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 371/747] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:22:41 2022] POST /identity/v3/services => generated 240 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:41.380480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:41.427322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.429824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.435997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.568045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354bf4-35a6-4ffc-b55d-94cffd38f396 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.606863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.614356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.615973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.616477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.616963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.621980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 377/748] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:41 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 21 10:22:41.623593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:41.627701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.630195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:41.648579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:41.649676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:41.650752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:41.653049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 372/749] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:41.653420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:41.821240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754b1d2-d33d-4899-a236-18572d508259 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.828990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aaeb2e-ab32-4a56-b143-bcd2a4f3623a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:41.834351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:41.879387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.880605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.881071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.881564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.902817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:41.903235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:41.904465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:41.905123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:41.905510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:41.905989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:41.936985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:41.939019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:41.941045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:41.941045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:41.941045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:41.941045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:41.946457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 373/750] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:41.947962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.038467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:42.042903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:42.045442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:42.206778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f41a4b5-3ee7-4d0e-b3f9-0a0177a31cee None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:42.232205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 378/751] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:41 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:22:42.232205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.232205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:42.306836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:42.307656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:42.307835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:42.308105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:42.308942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:42.309251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:42.314088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:42.366797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 374/752] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:42.366797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.492899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1057c79-2a84-4390-b365-0bec66b90f57 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:42.576292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:42.577263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:42.577691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:42.578153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:42.579044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:42.580775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:42.583103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:42.608891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762a790-3757-40d2-991a-47cd943624f2 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:42.610913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 379/753] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:42.612144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.618686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:42.687206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:42.747368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:42.749334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:42.750173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:42.750904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:42.751472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136a96-f6a1-4eb8-ba2e-3e9f0dfe8bf8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:42.774873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:42.778447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:42.794938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:42.795744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:42.796015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:42.796283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:42.809154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:42.810673 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:42.819420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:42.821195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:42.824318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:42.824318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:42.824318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:42.824318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:42.828088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 375/754] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 465 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:42.829994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:42.835769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:42.837515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:42.839355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:42.839355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:42.839355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:42.839355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:42.839355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 380/755] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:42.843349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:42.993339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4639b-1058-492a-9acd-23673b3530ab None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.016190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.026933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74efd5d-65fe-4d89-a913-fdba9fe0d1f1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.037471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.038215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.038502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.038781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.039536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:43.039847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.041430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.056329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 381/756] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:43.057589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.082285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.083352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.083627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.083894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.091840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.093364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-913836cb-caa7-4063-87e2-5f6d614617d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:43.109182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:43.110236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:43.111137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 376/757] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:43.112351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96d7a-a3be-4a0f-a3d2-efb461bb0f68 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.112351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96d7a-a3be-4a0f-a3d2-efb461bb0f68 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.112351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e96d7a-a3be-4a0f-a3d2-efb461bb0f68 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.118628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 377/758] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:43.118628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96d7a-a3be-4a0f-a3d2-efb461bb0f68 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.136683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.235559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e96d7a-a3be-4a0f-a3d2-efb461bb0f68 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.270991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d966d-6a95-4f32-82c7-76290606ee6e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.299412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.301208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.301761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.302300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.316457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.319466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.337301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.338422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.339046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.339507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.340742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:43.341285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.343875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0c834e03-75c1-4b86-9cee-f9339f303414 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:43.347407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:43.348654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:43.349534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 378/759] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:43.351438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.351965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.352483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.367179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 382/760] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:43.368451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.380501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:43.381971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:43.420500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.470106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 379/761] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:43.471662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.478856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.523882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de944cd5-83f1-4935-8f59-cbde535a6dba None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.570332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.570597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.570697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.570975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.571746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:43.572048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.573562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.589133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 383/762] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:43.589774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.622714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1bec3-2141-49f6-829e-aff1108a15a1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.668933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.670041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.670564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.671027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.672102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:43.672625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.674723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.697944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 380/763] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:43.697944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.715140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.725492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c3c61-bf11-4579-9a6d-63fdf72c2319 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.768016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.768817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.769495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.769495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.778563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.779961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.785663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:43.808094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:43.809082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:43.809988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:43.815209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 384/764] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:43.817918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.841439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0e3f4-9f72-4243-9b31-6514de0b8a52 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:43.879874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:43.880706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:43.880982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:43.881247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:43.881926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:43.883349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:43.896909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:43.897971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:43.899145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 381/765] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:43.900031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:43.985225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc834815-7bd2-4bfe-8a5e-a9dd9669369d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.023973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb97729e-787e-4859-81bb-dacfdad9b608 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.048078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.049401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.049910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.050645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.052575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ab0772e95f25425286c921316cc19411) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:44.053141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.055733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:44.055919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.065529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.066340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.074136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.074355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 385/766] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/role_assignments?user.id=ab0772e95f25425286c921316cc19411&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:44.074475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.074475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=965fa890ec864b0c870bba47db2f7ffb) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:44.074475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.074714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.074789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.077121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 382/767] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:43 2022] GET /identity/v3/role_assignments?user.id=965fa890ec864b0c870bba47db2f7ffb&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:44.078098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.148498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:44.298889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20119d-90a1-4226-93d5-cfd5a97cf077 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.320971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df405dd4-8f57-4e4e-86a2-33c3f80a526a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.344757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.345556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.345906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.346308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.347319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:44.347709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.349314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24c0c1-e861-4ff2-b59b-f4d6dffe625a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.371941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 386/768] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:44.371941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bce1d-a0e2-4038-9dbb-a1abc46c020a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.372664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bce1d-a0e2-4038-9dbb-a1abc46c020a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.372664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bce1d-a0e2-4038-9dbb-a1abc46c020a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.377355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.378120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 387/769] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:44.379476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bce1d-a0e2-4038-9dbb-a1abc46c020a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.379883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.380374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.380865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.381829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:44.382234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.383980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba4875-3d7b-40c9-bd0c-4ad34761b91f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.391096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 383/770] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:44.392038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.392319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.392614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.422409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:44.423817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:44.539714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:44.564072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:44.578227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 384/771] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:44.580339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.603987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bce1d-a0e2-4038-9dbb-a1abc46c020a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.678253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.679662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.680132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.680600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.684675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=a43c2cee600846c99e25b81e21726370, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.687532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.709943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 388/772] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:44 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:44.711334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.787479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bbbaf-dd83-48c7-92d2-ce5d45b887a0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.860767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.861560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:44.861952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:44.862366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:44.863343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:44.865342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:44.871411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:44.888761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 385/773] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:44.898972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6b7a58-6baf-4ffb-b25c-2cf68922943a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:44.907187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:44.998261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:44.999561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.000054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.000535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.001421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.003780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:45.019752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:45.021729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:45.023309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:45.025308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 389/774] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:44 2022] GET /identity/v3/services/network => generated 88 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:45.027266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:45.028648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:45.035132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:45.152858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c4f90-c466-4a44-9aab-475307657fc4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.229339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:45.230031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.230332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.230609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.231421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] RBAC: Adding query filter params (interface=public, service_id=8d1ecd89a9f9478dadb6e8260415acdf, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:45.231729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.233157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.249625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5242c58-3abe-4496-b95b-837674bc2396 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.260205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 386/775] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:22:44 2022] GET /identity/v3/endpoints?service_id=8d1ecd89a9f9478dadb6e8260415acdf&interface=public®ion_id=RegionOne => generated 194 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:45.262663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:45.327637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:45.328351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.328627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.328899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.330019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] RBAC: Adding query filter params (name=network) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:45.331481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.333493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.343260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 390/776] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:45.345620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:45.462650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:45.496930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae548dc-5b27-439c-98e5-9a7ccdce62a9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.518458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:45.520357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dee2a2b-ad8f-44f6-ad0e-1f70fe141c70 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.564109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:45.564800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.565080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.565352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.566424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] RBAC: Adding query filter params (type=network) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:45.567523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:45.568211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.568551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.568819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.569557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.571000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.572539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.573993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.582943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 387/777] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:22:45 2022] GET /identity/v3/services => generated 772 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:45.588939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 391/778] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:45.591947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:45.743903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81065c-07cf-497a-97ce-4bde2ec8e4cb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.793863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:45.794997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:45.795623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:45.796118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:45.797174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] RBAC: Adding query filter params (interface=public, service_id=824e964dd3cc4ea8807d2db0f95aec6d, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:45.797711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:45.799452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdde3d1-157c-49fd-a288-219d37f20bdd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:45.806253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 388/779] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:22:45 2022] GET /identity/v3/endpoints?service_id=824e964dd3cc4ea8807d2db0f95aec6d&interface=public®ion_id=RegionOne => generated 194 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:45.812034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:45.956582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79991fd9-9689-429b-b13b-fb3660f09211 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:45.990579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:45.999703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:46.000502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.006513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.006823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.007537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:46.008951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c7b2fd-3b30-43f5-abf9-42c64eb4a8ff None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:46.015378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 392/780] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:22:45 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:46.528493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ffd2-a08f-452c-a3a4-c65fc6bd1db4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.529010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ffd2-a08f-452c-a3a4-c65fc6bd1db4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.529010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac8ffd2-a08f-452c-a3a4-c65fc6bd1db4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.530640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 389/781] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:46.536420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce65-99c7-4236-a451-b35858d7ea5a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.536708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce65-99c7-4236-a451-b35858d7ea5a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.536989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ce65-99c7-4236-a451-b35858d7ea5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.562268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6188ce65-99c7-4236-a451-b35858d7ea5a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:46.563481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6188ce65-99c7-4236-a451-b35858d7ea5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:46.664834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 393/782] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:46.711842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8ffd2-a08f-452c-a3a4-c65fc6bd1db4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:46.741414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50beed5-c987-4fdc-9049-330af12b1e43 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.741754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50beed5-c987-4fdc-9049-330af12b1e43 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.741979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50beed5-c987-4fdc-9049-330af12b1e43 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.743551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 394/783] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:22:46.749159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157533db-55bb-46f1-9942-f7c815150439 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.749447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157533db-55bb-46f1-9942-f7c815150439 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.749731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157533db-55bb-46f1-9942-f7c815150439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.778337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:46.783213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-157533db-55bb-46f1-9942-f7c815150439 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:46.784377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-157533db-55bb-46f1-9942-f7c815150439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:46.846794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac8ffd2-a08f-452c-a3a4-c65fc6bd1db4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:46.910816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:46.911646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:46.911929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:46.912204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:46.921921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 395/784] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:46.928416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:46.936234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:46.937193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:46.938039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 390/785] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:46.944075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157533db-55bb-46f1-9942-f7c815150439 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:46.959449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.050472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.130152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157533db-55bb-46f1-9942-f7c815150439 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.154630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc6324-e29a-47d2-8dd0-994ee2f25276 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.156390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.178287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.179008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.179299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.179581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.180478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:47.180795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:47.182385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:47.192126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 396/786] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:47.199815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.221574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.222465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.222747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.223021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.234749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-70ec6a07-be70-47cc-9530-646bff6b4426 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:47.242561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:47.243528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:47.244379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 391/787] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:47.245615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61554-1206-4dc0-9604-6d4f0e6f8351 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.245724 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61554-1206-4dc0-9604-6d4f0e6f8351 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.245940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61554-1206-4dc0-9604-6d4f0e6f8351 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.248468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 392/788] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:47.252641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61554-1206-4dc0-9604-6d4f0e6f8351 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.370651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61554-1206-4dc0-9604-6d4f0e6f8351 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.402908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c99056-8bc0-4c45-b215-cc60715134fc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.406831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.407505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.407786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.408060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.409851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:47.409851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:47.410883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d81ffd-2209-4e9a-ab39-db8990269926 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:47.420097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 393/789] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:47.421254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.421543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.421821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.439064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:47.440376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:47.449262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.459580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.479988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.481976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.482825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.483718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.507006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:47.510584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:47.518133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 394/790] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:47.519109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:47.546953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:47.549147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:47.551021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:47.551021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:47.551021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:47.551021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:47.555025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 397/791] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:47.562075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.644564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde0901-45aa-45ad-bc29-8ba37ed2422c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.698957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.700966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.701758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.702557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.718085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebf500f-5872-40cb-9143-7fdd00bd695b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.722869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:47.726151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:47.755535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:47.756559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:47.757567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:47.757567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:47.757567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:47.757567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:47.762128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 395/792] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:47.763161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.766404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.768632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.769228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.769728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.774528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.790036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:47.803704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:47.804724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:47.805586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:47.808710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 398/793] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:47.809736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.859802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:47.913641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78a518-2a18-4808-8f3f-ef9b3f33f7c9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:47.957455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:47.958589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:47.959100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:47.959541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:47.960408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:47.960852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:47.962718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:47.982451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 396/794] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:47.983693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:47.995444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be26b0-dbe0-4959-bbe0-d3921f8d680b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.038948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.040034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.040155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.040541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.041390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:48.041856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.043882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.062722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 399/795] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:48.063855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.073211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.127370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889540-4a9e-4c63-aa07-35ddc50ff3ab None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.174310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.175498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.176343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.176796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.177728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:48.178212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.180453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.183805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.195444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 397/796] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:48.196541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.201528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e124-1309-4a4f-a991-19459e40aed8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.251937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.253053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.253617 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.259828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.272381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.274197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:48.290967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:48.292192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:48.293390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 400/797] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:48.294428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.361985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef9ce8-a606-4d46-ab9d-255d095e075d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.391315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.401619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.402487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.402863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.403099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.412702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.414644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.418146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0f261-5295-4227-913e-b49fa2933503 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c0d25594-6cd1-4cc9-a17a-23ecb014fb00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:48.431475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:48.432975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:48.434040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:48.437508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 398/798] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:48.438895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4821-21b2-4aaa-b518-11931aed3151 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.439183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4821-21b2-4aaa-b518-11931aed3151 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.439459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f4821-21b2-4aaa-b518-11931aed3151 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.441069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 399/799] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:48.441551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f4821-21b2-4aaa-b518-11931aed3151 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.476586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.478369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.478877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.479371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.493240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.494654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:48.515687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:48.524015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 401/800] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:48.525080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.526724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.576337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f4821-21b2-4aaa-b518-11931aed3151 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.620374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.621082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.621366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.621645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.622552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:48.622867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.624374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d215912-a621-4a27-83a3-8077b6066fc8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.645136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 400/801] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:48.646571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8045e1-e8cb-4bae-86bd-15b6509f73cc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.646860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8045e1-e8cb-4bae-86bd-15b6509f73cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.647137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8045e1-e8cb-4bae-86bd-15b6509f73cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.659347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adfad58-eca4-4469-aad0-ff28f5ea76da None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.665171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6d8045e1-e8cb-4bae-86bd-15b6509f73cc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:48.666531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d8045e1-e8cb-4bae-86bd-15b6509f73cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:48.700805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.701395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.701678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.701954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.702853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:48.703207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.704694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.714929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.725901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 402/802] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:48.726867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.745380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 401/803] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:48.746772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11b04-d9cd-495e-bce4-9a0db1683be7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.747058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11b04-d9cd-495e-bce4-9a0db1683be7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.747338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c11b04-d9cd-495e-bce4-9a0db1683be7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.748586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 402/804] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:48.749272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11b04-d9cd-495e-bce4-9a0db1683be7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.813059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:48.856080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6187e85f-f4ad-4f2f-983a-232a605abd41 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.858671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c11b04-d9cd-495e-bce4-9a0db1683be7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:48.890788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.891462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.891749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.892030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.892760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:48.893071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.893369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:48.894361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.894619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.894723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.894908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.906184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:48.907103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 403/805] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:48.907662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:48.907933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c32851c5-3df4-4512-be1d-64c0ea37daa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:48.926947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:48.927961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:48.928875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:48.928875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:48.928875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:48.928875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:48.928875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 403/806] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:48.929719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:48.929979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:48.930284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:48.946713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:48.947898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:48.970624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.016703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156af62f-04a0-445a-b9b5-75e90857d3a9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.017288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 404/807] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:49.018176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.039647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.053737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.054608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.054886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.055161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.066197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.067675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:49.084981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.086171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.087303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:49.087303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:49.087303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:49.087303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.087303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 404/808] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.087643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.123815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688bafd-d4a7-48ee-b146-f0037f80a2fe None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.159013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12368200-e909-4d83-b510-eb9751267fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.159867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368200-e909-4d83-b510-eb9751267fad None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.160166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368200-e909-4d83-b510-eb9751267fad None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.160508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12368200-e909-4d83-b510-eb9751267fad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.161166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12368200-e909-4d83-b510-eb9751267fad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.162606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12368200-e909-4d83-b510-eb9751267fad None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-12368200-e909-4d83-b510-eb9751267fad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.174771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.176017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:49.176906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 405/809] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.177764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12368200-e909-4d83-b510-eb9751267fad None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.191634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f5799a-4d1d-4e5c-93a3-0dc479478e38 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.201888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.226597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.227295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.227968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.228240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.236229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.237876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:49.252412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.253557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:22:49.254582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.258404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 405/810] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.259171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.285582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12368200-e909-4d83-b510-eb9751267fad None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.294222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.319448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.320141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.320406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.320677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.321400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:49.321705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.323137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.335231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 406/811] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:49.336040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.368011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f8df54-7351-4788-9144-17047321af9a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.401335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.402495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.402799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.403058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] PATH_INFO: `/v3/services/network` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.403714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.405111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.416775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.416926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.417988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 406/812] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/services/network => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.419885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.439555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beef155-15d7-455b-8891-b7458d4e488d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.474166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.474833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.475112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.475383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.476107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:49.476413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.478233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.489570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 407/813] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:49.490401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.513797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.521087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a2a8b4-f9c8-42b5-b2c7-e8268e93c513 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.557444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.558160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.558447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.558721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.559439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:49.559751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.561151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.570482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 407/814] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:49.570482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.591700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd40781-4ff1-44a9-b4aa-7721582b0443 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.628434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.628694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.628931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.629396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.630275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:49.630605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.632067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.646684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.652123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 408/815] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:49.653433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.674458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a5489-66cb-405d-84db-be6050c3e543 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.711883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.712683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.712958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.713246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.720124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.721588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:49.736640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.737728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.738668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 408/816] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.739181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.758692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9dd6b2-3021-4383-a434-ee39ac4845bf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.761995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.794695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.795363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.795641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.796285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.796611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] RBAC: Adding query filter params (name=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:49.796911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.798330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.803438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 409/817] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:49.804215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.843130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609d4d9-dfe8-41c2-a640-5391f0d7310d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:49.870367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:49.880508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:49.881304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:49.881583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:49.881855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:49.888479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:49.889945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:49.904615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:49.905625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 409/818] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:49.912797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:49.913472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83098f-8061-4c6a-b503-75954709340e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.003480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.026253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2627f57-dcef-43c1-a289-1d8fbb1820bb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.062872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.063530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.063804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.064074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.069161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.069831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.070116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.070400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.071098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:50.071402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.072778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.077763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 410/819] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:50.078620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.138885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.140379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.181640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1523297-e07d-45a6-b747-e4e8c04a5970 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.208774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.217134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.217788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.218113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.218409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.219169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:50.219511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.220950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.222650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.234338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 411/820] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:50.235166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.243771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 410/821] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:22:50.244625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.341408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1787a35-65b9-47ca-9cdd-631aeb8cc019 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.347163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcd39-820f-49ba-99b1-ead27ea6cded None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.376385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.377050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.377328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.377600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.378460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:50.378780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.380195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.382954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.383624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.383908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.384189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.384923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 412/822] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:22:50 2022] GET /identity/v3/services?type=network => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:50.385042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:50.385259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.385666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.386754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.399852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 411/823] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:50.400548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.439588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.444291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.489817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e6cf8-30c1-40f8-9c51-3ed713025ab7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.502748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27161a-2b67-43d1-bcc0-2e0c876428c1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.524521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.525100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.525381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.525662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.526437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.527820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.536748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.537607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.538086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.538214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/965fa890ec864b0c870bba47db2f7ffb/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.540365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=965fa890ec864b0c870bba47db2f7ffb, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.541893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.549586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 413/824] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:22:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:50.550738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.555671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 412/825] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:50 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/965fa890ec864b0c870bba47db2f7ffb/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:50.556789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.685721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ada049-f79d-4ffe-9ede-9f7deb5208ae None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.688647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.704986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:50.709842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be7de17-fe3e-48d2-b333-df338d4801a0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.731221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.732044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.732327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.732601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.745415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.746991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.759316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.760333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.760819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.761276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:50.762256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:50.763880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:50.769505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:50.770737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:50.771940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:50.771940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:50.771940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:50.771940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:50.772651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 414/826] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:50.773882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.796961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 413/827] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:22:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:50.798140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:50.910164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88a4a-aede-432f-abb3-60eeebf94ec1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.928442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663399-fea0-4bbb-b754-342170497076 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:50.996118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:50.997310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:50.997762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:50.998216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ab0772e95f25425286c921316cc19411/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:51.020524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:51.021506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:51.021960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:51.022403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:51.023325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:51.024735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:51.026391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:51.035172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=ab0772e95f25425286c921316cc19411, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:51.036971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:51.051387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 414/828] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:51.061313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:51.070977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 415/829] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:22:50 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ab0772e95f25425286c921316cc19411/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:22:51.083116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:51.195156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb7dcd7-9908-4aad-8114-bfa8a67dfa5d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:51.250006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:51.251283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:51.251743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:51.252244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:51.267634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:51.270374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:51.289790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:51.291042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:51.292566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 415/830] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:51.297557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:51.307727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:51.434632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c4d268-e30d-4f11-a3df-83a0d2ba933d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:51.477085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:51.478696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:51.479263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:51.479831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:51.480859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:51.481384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:51.483159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250de0c3-cc13-4e96-be6a-5b542572421c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:51.498467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 416/831] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:51.510081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:51.598833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:51.629731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52c563-a2e7-4fbf-8fe4-59200ea27e37 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:51.674786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:51.675565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:51.675851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:51.676126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:51.676975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:51.677285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:51.678783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ff5d5-f524-4d8e-a4eb-fe6f08c70301 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:51.685669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 416/832] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:51 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:52.960845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343ca-d37f-4601-8773-347f95ba9767 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:52.961708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343ca-d37f-4601-8773-347f95ba9767 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:52.961708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76343ca-d37f-4601-8773-347f95ba9767 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:52.963539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 417/833] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:52.969251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:52.969979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:52.969979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:52.988369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:52.989597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:53.064744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 417/834] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:53.084190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76343ca-d37f-4601-8773-347f95ba9767 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.154165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:53.196643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76343ca-d37f-4601-8773-347f95ba9767 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:53.233553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:53.234287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.234568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.234846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.235511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:53.236910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0b72f403-005b-4f78-a9dc-62344754baa7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:53.249950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:53.253777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:53.255661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 418/835] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:53.263191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.339026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:53.343761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667e9f-a60a-4b83-b148-2830ae50f482 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.344405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667e9f-a60a-4b83-b148-2830ae50f482 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.344897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90667e9f-a60a-4b83-b148-2830ae50f482 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.346834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 419/836] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:53.353144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838d02-e7f8-4dad-9c5a-aab702b39cb8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.353738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838d02-e7f8-4dad-9c5a-aab702b39cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.354269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838d02-e7f8-4dad-9c5a-aab702b39cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.372174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e8838d02-e7f8-4dad-9c5a-aab702b39cb8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:53.373760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8838d02-e7f8-4dad-9c5a-aab702b39cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:53.376331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5d880-befc-4f98-beba-2f8dca2b45a8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:53.413553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:53.414365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.414805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.415226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.416111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:53.416563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:53.418333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:53.428768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 418/837] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:53.430460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.454176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 420/838] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:22:53.457832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b6a-b18e-4b4e-b131-ad69dfc41d81 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.458404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b6a-b18e-4b4e-b131-ad69dfc41d81 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.459939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad83b6a-b18e-4b4e-b131-ad69dfc41d81 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.466521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 421/839] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:53 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:53.473616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.474148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.474638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.494428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:53.495574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:53.563140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:53.572872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3305c2e6-e739-421d-b20a-c10e913e7d3d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:53.582140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 422/840] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:22:53.582140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.630084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:53.639337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:53.640191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.640531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.640864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.641755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:53.642187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:53.643973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:53.650009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 419/841] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:53.651472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.735180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba0a7-419e-4287-bbde-4e70a1cb4df9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:53.804710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:53.806585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.806998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.807408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.826215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7370d178-724b-4f53-a1e7-08745d670ae5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:53.841260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:53.842347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:22:53.843190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:53.843846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 423/842] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:53.845701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576cfe-d799-486f-b6b2-158b0702c018 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.846196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576cfe-d799-486f-b6b2-158b0702c018 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.846646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff576cfe-d799-486f-b6b2-158b0702c018 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.849795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 424/843] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:53.855486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576cfe-d799-486f-b6b2-158b0702c018 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:53.859551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585a532a-74f0-4b41-9f02-f4e4cbd0df13 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:53.923409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:53.924797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.925526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.926039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.936323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:53.947315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b3ed43cc-9202-4cf9-9cd8-07451efba1ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:22:53.960277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:53.962550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:22:53.964815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:53.969236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 420/844] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:53.971192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:53.972284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:53.972284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:53.999718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:54.001609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:54.024196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff576cfe-d799-486f-b6b2-158b0702c018 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.098594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.098594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.098594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.098594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.099227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:54.099688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.102044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:54.103091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.122866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 421/845] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:54.124631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.125542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 425/846] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:22:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:54.136927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.295679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0195cbea-56eb-4c1c-8d1b-a27a5de31a38 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.321353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:54.327646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a3fa1-0cdc-4b4d-9456-7294de46e700 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.358211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.359525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.359972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.360459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.373113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.374215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.374691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.375182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.376839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:54.377584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.379469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.379820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.382493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.390822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 422/847] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:54.392578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:54.416357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:54.417402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:54.418358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:54.418358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:54.418358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:54.418358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:54.418640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 426/848] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:54.419961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.466496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:54.553586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3afebc-23a1-4a03-a0d2-e383c10aae4f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.578836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c370d-6347-47b7-be0b-84de11f89252 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.605612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.606665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.607087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.607568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.608376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.609928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:54.624896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:54.626871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:54.628464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 423/849] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:54.630128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.649522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.650840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.651288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.651732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.669201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.670972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:54.692584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:54.694313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 427/850] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:54.696585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.719763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:54.809705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f39a0-d88b-4648-9ce7-f8a50b1ed397 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.824835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e9998f-16f6-4857-a2c5-4d33047efb4c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:54.835050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:54.866374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.866845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.867105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.867843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.868114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:54.868390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.869783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.875646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 428/851] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:54.876214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.890232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:54.891417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:54.891934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:54.892405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:54.893657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:54.895231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:54.897802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:54.928401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 424/852] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:54.928401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:54.993510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:55.018966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31566fc1-dd64-4a03-bf53-dbee8bdfc0df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.061338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.062360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.062537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.062884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.064087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:55.064573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.067055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.086104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 429/853] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:55.087409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.112576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122038df-ee02-45cf-9253-3f0260c0c9e0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.172104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.173010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.173429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.173897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.175313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:55.176480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.177336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.186591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 425/854] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:22:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:55.196000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.290149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:55.310024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3f5fbd-3e76-497c-b928-e9cb810286c6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.401109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.404001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.405196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.406625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.422897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.424703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.428710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266069df-7718-4ec9-8fc3-bf82522e7fee None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.431016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:55.447123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:55.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:55.451458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 430/855] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:55.455078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.500469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.501808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.502284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.502878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.516965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.519965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:22:55.549077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:55.551455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:55.553503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 426/856] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:55.558280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.653500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df740f98-f0e9-4334-9bbc-539cddb69754 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.720938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.722512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.722512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.722963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.723994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:55.724668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.726797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.752798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 431/857] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:55.758445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.773968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:55.788861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde31a6a-cd22-483d-b530-65392a1e601a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.841107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:55.849000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.850671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.851466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.852217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:55.854492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:55.855336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:55.857927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:55.880333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 427/858] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:55.885669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:55.900201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c4337-c4c1-4ebc-854f-52e0cdb8cbe1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:55.953645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:55.954682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:55.954971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:55.955245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.045260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2445643-8591-4406-aa95-5bceb7c28afb None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.063030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.065503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b06489-2dee-44d4-bcb0-599764233fce None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.110186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.111142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.111661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.112137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.135153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.153419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.186122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 432/859] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:22:56.187569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08552a41-86ab-4df4-88ab-b4d2e20e6cb0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.187937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08552a41-86ab-4df4-88ab-b4d2e20e6cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.188219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08552a41-86ab-4df4-88ab-b4d2e20e6cb0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.190086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 433/860] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:56.194007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08552a41-86ab-4df4-88ab-b4d2e20e6cb0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.235819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.237539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fd2fc2-9b5b-4331-b008-e7194d946ac0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.340283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08552a41-86ab-4df4-88ab-b4d2e20e6cb0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.389353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.390586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.390865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.391131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.399453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 428/861] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:22:55 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:22:56.400787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.401082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.401354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.408771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.415617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.420920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:56.422161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:56.434968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:56.436003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:56.437129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:56.437129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:56.437129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:56.437129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:56.437129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 434/862] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:56.442173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.458381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.486199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.518103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 429/863] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:56.519238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.593026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df78341-603a-46b5-8fb5-a1c0f7d5ab3b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.637964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.638969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.639257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.639645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.652564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.656749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.657287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ff660-5393-4a37-a247-a9826818e066 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:22:56.683232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:56.684759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 435/864] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:56.700806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.701425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.701425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.701425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.701425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.701744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:56.701744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.701744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.713153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 430/865] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:56.713153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.777515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.785994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:56.833142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5eae01-8bfe-4c6e-8fc1-d9241d71dc04 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.855434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9f464-f359-481b-898d-bf847b46588b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:56.872160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.872832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.873111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.873382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.874132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.875530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.902102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 436/866] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:22:56 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:22:56.902102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:56.924446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:56.927462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:56.928667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:56.929244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:56.930736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:56.931528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:56.934485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:56.967713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 431/867] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:56.973807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.053723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bbb34-18e6-4ed3-85b7-ada821792680 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.091383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:57.107122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.109675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.109675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.109675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.120590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.123062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.124970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:57.130680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6e1d0-1299-4991-8f61-2733277209e0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:57.141791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:57.144705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:22:57.146772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 437/868] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:57.148970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.192823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.193639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.193922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.194226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.211627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.216140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:22:57.242738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:57.243811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:22:57.244712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:57.248079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 432/869] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:22:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:22:57.254185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.286187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d111d3-77aa-48a8-a857-7307ab80fb7f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.324818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.325498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.325779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.326081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.326912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:57.327221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.328774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.346974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 438/870] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:22:57.351222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.398350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186f3d7-fc53-438c-9747-1da0aca3de3e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.413997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:57.443532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.444216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.444503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.444781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.446000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:57.446000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.447441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.469528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 433/871] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:22:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:57.483852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.499653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6aa899-a236-4ed9-937b-1b44f35408fa None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.512228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:57.552976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.554187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.554667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.555167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.556840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ab0772e95f25425286c921316cc19411) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:57.557396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.559774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93da5e-59ba-428f-8624-433bd901e4ac None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.578115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 439/872] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:57 2022] GET /identity/v3/role_assignments?user.id=ab0772e95f25425286c921316cc19411&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:57.578115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb388df9-68aa-42f4-ac0f-9403bde99111 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.578115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb388df9-68aa-42f4-ac0f-9403bde99111 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.578115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb388df9-68aa-42f4-ac0f-9403bde99111 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.578115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 440/873] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:57.580282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.580580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.580832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.601358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:57.603075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:57.659649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d15a4c-cefb-4626-aa79-6d4ddbe1aa07 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:57.705450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 441/874] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:57 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:57.730591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:57.732370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:57.733061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:57.733342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:57.733615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:57.734814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=965fa890ec864b0c870bba47db2f7ffb) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:57.735127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:57.738378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f77e57-5359-4ca6-af66-99055630d039 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:57.748093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 434/875] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:22:57 2022] GET /identity/v3/role_assignments?user.id=965fa890ec864b0c870bba47db2f7ffb&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:57.799751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:57.951254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c443c-7e3f-4efe-b1e4-ff85f2b4e21c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:58.023604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:58.024753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:58.025307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:58.025807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:58.027227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:58.029796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5a704a-aa0a-4c5c-9575-6ed8b4f5bc6e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:58.064204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 442/876] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:22:57 2022] POST /identity/v3/services => generated 269 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:22:59.172937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fb45-b810-483a-8a51-00a8b42f37c6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.173515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fb45-b810-483a-8a51-00a8b42f37c6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.173515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a867fb45-b810-483a-8a51-00a8b42f37c6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.175408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 435/877] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:22:59.181677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.182239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.182315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.201548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:59.202819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:22:59.295408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 443/878] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:22:59.319695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867fb45-b810-483a-8a51-00a8b42f37c6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:59.490105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:59.527247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a867fb45-b810-483a-8a51-00a8b42f37c6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:59.590758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:59.592090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.592536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.593005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.594275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:59.597705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:22:59.622222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:22:59.623296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:22:59.624147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:22:59.625416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 436/879] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:22:59.631146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:59.657316 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:22:59.739166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0932bbb8-6078-45b1-9cb6-5983bbae1229 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:22:59.775355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:22:59.775951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.776229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.776503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.777222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:22:59.777527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:22:59.778942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b270fa1d-be31-4b35-ad4d-b8dbf1a0c8a1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:22:59.784466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 444/880] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:59 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:22:59.790992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:22:59.964568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3119b-b414-42af-9054-572fa6578f1a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.964914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3119b-b414-42af-9054-572fa6578f1a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.965112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe3119b-b414-42af-9054-572fa6578f1a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.966831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 445/881] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:22:59.972658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:22:59.972975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:22:59.973261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:22:59.992564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:22:59.993775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:00.070426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 446/882] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:22:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:00.087910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.107743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:00.150698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5907fb-7b50-40ef-b08b-4b671ad6149c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.197557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.198799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.199330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.199740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.200463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:00.200771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:00.202410 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:00.214563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 437/883] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:22:59 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:00.215547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.235041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:00.284964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b79b9-a84c-4858-ac6b-6f3863a93787 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.344497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.352891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.354415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.355758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.380018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff516d80-0027-4c3b-9813-a9e209756431 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.386255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:00.409700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:00.411618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:00.413256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:00.418552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 447/884] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:00.422644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.429481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.430253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.430535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.430857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.431675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] RBAC: Adding query filter params (interface=public, service_id=219ecf5b02ad4e5ba7f2cdaef892e3ec, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:00.432002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:00.433505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:00.447541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 438/885] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/endpoints?service_id=219ecf5b02ad4e5ba7f2cdaef892e3ec&interface=public®ion_id=RegionOne => generated 194 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:00.448517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.551667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:00.578179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:00.596665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77e6cc-3c2e-4761-83c2-03ff8a83f40e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.622309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c93a8-9d9d-4fa7-9d5f-feab89c47318 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.637886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.638595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.638878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.639155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.639845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:00.641251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3203916-e963-477d-8236-1bfb0a62a75c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:00.658091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 439/886] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/services => generated 1268 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:23:00.658091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b35e-bd9c-4253-a23b-3029ff2e3bbb None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.658091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b35e-bd9c-4253-a23b-3029ff2e3bbb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.658091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0b35e-bd9c-4253-a23b-3029ff2e3bbb None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.658091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 440/887] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:00.667741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.668607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.669167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.672798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.673655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.674041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.674452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.675525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:00.675899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:00.677467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:00.688327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 448/888] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:00.694676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.702371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:00.704486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:00.794839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 441/889] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:00.847454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:00.885011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd86c-6d24-4ebc-a758-87979d05cea0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:00.933011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:00.954253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:00.955631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:00.956116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:00.956643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:00.976580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:00.979526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:00.980311 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579fadf-2f60-4ce4-afc5-0c8a50f2cc67 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.010551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:01.015063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:01.016042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:01.016948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:01.016948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:01.016948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:01.016948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:01.020244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 449/890] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:01.025485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.026607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.027473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.027729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.028004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.028670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.030118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:01.044219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:01.045315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:01.046623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 442/891] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:01.055009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.155616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b53c08-2223-425c-9423-f8dfcd3f429f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.175249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd4885-f18e-4979-bc3f-91cbe4583c82 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.189566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.190274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.190584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.190860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.191671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:01.192105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.193510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0b5e8-4adc-487c-a74b-51341dce40c7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.206512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 450/892] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:01.208059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f288e5-81cf-41eb-b382-d74ee9570e3e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.208344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f288e5-81cf-41eb-b382-d74ee9570e3e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.208617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f288e5-81cf-41eb-b382-d74ee9570e3e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.210142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 451/893] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:01.212169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f288e5-81cf-41eb-b382-d74ee9570e3e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.215411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.223285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.224097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.224380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.224661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.225391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:01.225697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.227284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40053145-3683-4fc0-9b16-26f624c09f84 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.238286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 443/894] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:01.239834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.240121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.240403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.265285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:01.266684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:01.282954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.340414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f288e5-81cf-41eb-b382-d74ee9570e3e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.380792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.381630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.381909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.382213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.391220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.392716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.396480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 444/895] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:01.397136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:01.416097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:01.417959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:01.419943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:01.422034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 452/896] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:01.423222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.542599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120c9a4-1d84-4897-ba41-f8c64aeb6ae9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.546293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799467e-f689-4724-b16c-cf3e5e3df813 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.556591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.577386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.587665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.588782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.588966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.589156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.589307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.589606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.589869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.590263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.590417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.590882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:01.591189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.591426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.592584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.600255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 445/897] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:01.602235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:01.605908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:01.607760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:01.609592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:01.612646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 453/898] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:01.613967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.743241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de985eef-6b4b-4800-8433-c7f2da53884f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.771933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf477f79-33b9-4f28-8dd5-fb4c7433b6cd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.782451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.783159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.783444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.783722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.784517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:01.784829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.786593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.797353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 454/899] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:01.798420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.812951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:01.813651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:01.813932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:01.814259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:01.815124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:01.815439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:01.817237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:01.842476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 446/900] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:01.843510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:01.846080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.914115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:01.938463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59308da-9aca-4c2b-bb66-ad531361f0e9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:01.989827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea24ac6-ee78-4891-9f66-3a9e72145729 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.016037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.018403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.019597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.020807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.023313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:02.024354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.028756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.030425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.031196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.031574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.031949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.043998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 455/901] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:02.050112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.130518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.132339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.162852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86050-97fb-494f-a181-7a0e7424ff1d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.166862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:02.197991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:02.217091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.218169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.218629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.219060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.220039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] RBAC: Adding query filter params (interface=public, service_id=de1ab0c267914cda994ca7f9f7412f26, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:02.220767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.223260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.238445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 456/902] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/endpoints?service_id=de1ab0c267914cda994ca7f9f7412f26&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:02.240331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.269538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 447/903] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:23:02.272839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.361857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd59b35f-35be-4331-985b-20a173c02fb8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.388840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7110d09-6ea7-45cc-88b9-164b651935d9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.401189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.402311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.402796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.403265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.404180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.405862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.422502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 457/904] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:23:02.428198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.429028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.429308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.429582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.443128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.444689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.455636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:02.466908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:02.467889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:02.468800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:02.468800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:02.468800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:02.468800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:02.468800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 448/905] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:02.474696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.511739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:02.596688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00be1b-4d7d-49fb-b137-186c349b6329 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.635771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.636462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.636744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.637017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.637763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:02.638102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.639529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.653211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 458/906] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:02.659063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf0a26-1707-4e11-a024-6b5200d81257 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:02.829646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:02.830499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:02.830782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:02.831058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:02.838855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:02.840430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:02.855652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:02.856614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:02.857512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 449/907] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:02.863889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:02.995046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:03.012547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64343ec1-a01e-47f3-b13a-75f67dbcbe5f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:03.062770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:03.063477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.063759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.064034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.064864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:03.065170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:03.067110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde9bd2-f243-4445-bf10-011dd2b3bcf6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:03.081708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 459/908] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:03.091957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:03.204442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:03.252629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102ab43d-4373-40f5-b14e-84ca899f36b4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:03.292303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:03.293070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.293254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.293517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.294402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] RBAC: Adding query filter params (role.id=fd1ac0e38492413ca7539e39d538093e, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ab0772e95f25425286c921316cc19411) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:03.294718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:03.296270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67796-52ac-4885-893b-0765bd2fb730 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:03.303164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 450/909] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:03 2022] GET /identity/v3/role_assignments?user.id=ab0772e95f25425286c921316cc19411&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fd1ac0e38492413ca7539e39d538093e => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:03.394138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d503-dc60-4401-8dec-5f3bfd13b36d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.395177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d503-dc60-4401-8dec-5f3bfd13b36d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.395672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382d503-dc60-4401-8dec-5f3bfd13b36d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.397843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 460/910] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:03.404491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.405525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.406106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.425245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:03.427056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:03.510121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 451/911] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:03.529256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382d503-dc60-4401-8dec-5f3bfd13b36d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:03.648163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382d503-dc60-4401-8dec-5f3bfd13b36d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:03.686697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:03.687537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.687818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.688091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.688762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:03.690206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:03.703340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:03.704416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 21 10:23:03.705287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:03.709795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 461/912] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:23:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:03.715237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:03.775759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:03.825173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d2fd8-9f88-4c77-b686-32a295330852 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:03.867998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:03.868700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.868979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.869254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.870001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:03.870346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:03.871837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3e9bf0-9e10-4e90-8104-d5d8cdfeef59 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:03.878286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 452/913] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:23:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:03.884533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:03.905453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:03.952938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17136398-e35c-4701-aac6-b30f39910fe3 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.953296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17136398-e35c-4701-aac6-b30f39910fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.953497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17136398-e35c-4701-aac6-b30f39910fe3 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.954946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 453/914] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:03.963938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:03.964408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:03.964788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:03.986145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:03.988559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:04.018983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ec6e7-3ec5-4d6d-acc5-7c1694fec73e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:04.065934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:04.067627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:04.068489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:04.069020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:04.070193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:04.071182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:04.073380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:04.081454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 462/915] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jun 21 10:23:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:04.083330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 454/916] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:04.087191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:04.112093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:04.169785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:04.193628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:04.219341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60555e52-c697-44ed-8afb-1162ae7383f3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:04.232238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4faf5b-caa4-411d-aa03-a16c6a4a8c2e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:04.258516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:04.259205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:04.259493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:04.259771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:04.260577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:04.262381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7934a-a53c-433f-aefe-c8650bcb079c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:04.275553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:04.277463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:04.278001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:04.278724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:04.279965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:04.281871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576467ee-c05e-4c3f-83b2-d468005cc1c5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:04.286490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 463/917] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:04.303909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 455/918] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:23:04 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:05.505438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df67e-a57d-433c-8438-7e1f9d48d8df None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.506313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df67e-a57d-433c-8438-7e1f9d48d8df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.506313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08df67e-a57d-433c-8438-7e1f9d48d8df None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.507802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 464/919] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:05.513746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.514507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.514507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.524135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002906-d924-4004-8ea8-7a5ebb40aa62 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.524404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002906-d924-4004-8ea8-7a5ebb40aa62 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.524545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b002906-d924-4004-8ea8-7a5ebb40aa62 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.526330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 465/920] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:05.532603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.532949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.533180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.540639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:05.543305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:05.552554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:05.553832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:05.670086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 466/921] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:05.685375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 456/922] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:05.699348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:05.717274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:05.790947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:05.814637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:05.897566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d610ea-80f5-448e-b822-ea2b84928657 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:05.899031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79055f76-fd5c-4a36-95e5-3adaa8bdd97b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:05.940090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:05.940976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.941260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.941524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.954278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:05.964528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:05.966438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:05.967997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 457/923] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:05.972202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:05.979474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:05.981427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:05.982328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:05.983105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:05.984637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:05.987904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:06.019121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:06.021066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 21 10:23:06.022758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:06.025143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 467/924] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jun 21 10:23:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:06.029908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.160980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:06.174088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0933f0-1883-4868-bc94-2ffa4847b132 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.211517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7299d8-656f-4992-8b96-d30111c49a4f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.215154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.215857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.216193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.216479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.217195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:06.217506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.218977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.234324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 458/925] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:06.235347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.262086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:06.288851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.290977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.291736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.292439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.294042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:06.294844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.297842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.309085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 468/926] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:06.316128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.361411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197652b3-6c16-412f-b50d-e827e84329a1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.401088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.401939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.402257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.402533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.415008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.416460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:06.436068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:06.438169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:06.440129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:06.440129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:06.440129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:06.440129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:06.442622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 459/927] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:06.443656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.461763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:06.540533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69bd783-a27e-4d08-b11d-3186cce740ef None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.580313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b21aaf-f7cb-434d-a35b-5aadba55239e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.583893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.584600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.584999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.585263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.586010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:06.586358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.587794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbe02e-7926-4153-b03a-fcf6b0c62773 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.594130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 469/928] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:06.600811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaedb9d-971b-43df-bc65-e0c927a27340 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.601402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaedb9d-971b-43df-bc65-e0c927a27340 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.601900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaedb9d-971b-43df-bc65-e0c927a27340 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.604949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 470/929] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:06 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:06.609392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaedb9d-971b-43df-bc65-e0c927a27340 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.652390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.653550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.654074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.654555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.655943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:06.656503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.659203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c19a8-1651-4f88-984b-8f910fd4c34a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.686937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 460/930] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:06.686937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.686937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.686937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.713641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:06.715807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:06.718445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:06.805553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaedb9d-971b-43df-bc65-e0c927a27340 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:06.858083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 461/931] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:06.858083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:06.858083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:06.878896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:06.880488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:06.880983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:06.881472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:06.883309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:06.887108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:06.918422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 471/932] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:06.922928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.079164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30cdb4-2459-4687-a3ce-0121cc9aba16 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.142954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fab641-0648-4432-a116-d4a340af3841 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.155129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.156450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.156915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.157375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.159087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:07.176240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.176995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:07.207452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:07.209327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:07.211310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 462/933] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:07.217511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.237746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.240243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.240986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.242028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.243499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.247491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:07.277753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:07.280043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:07.283810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:07.293250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 472/934] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:07.304091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.354566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:07.441187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430671bd-f70f-448e-b0de-60d28aa5fe95 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.504046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366dd8c-4bad-4a88-a764-c79786efc41c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.507027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.508159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.508654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.509146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.510815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:07.511367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.513940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757f7aa8-3ee0-48d5-a708-c7fa88d5a658 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:07.544122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 463/935] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:23:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:07.546520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83332-2714-44ab-88c6-a05cc1004a3f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.547023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83332-2714-44ab-88c6-a05cc1004a3f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.547490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e83332-2714-44ab-88c6-a05cc1004a3f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.554126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 464/936] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:07.554126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83332-2714-44ab-88c6-a05cc1004a3f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.585720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.586952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.587420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.587884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.589217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:07.589751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.592313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e7828-b6f4-4ca8-b0ed-0b546b78cbea None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:07.610668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 473/937] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:07.613980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.614470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.614919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.642945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:07.645389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:07.700916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e83332-2714-44ab-88c6-a05cc1004a3f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.701607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:07.726595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:07.743861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.744664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.744949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.745217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.759936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.762682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:07.776263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 474/938] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:07.777057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:07.810946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:07.812947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:07.814620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:07.814620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:07.814620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:07.814620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:07.818415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 465/939] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:07.820353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:07.935613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f27f68-1610-40c9-bff5-220200ad9d7a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.991615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:07.992685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:07.992809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3e064d-7633-42a9-9722-123323eba01f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:07.993111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:07.993558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:07.994807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:07.995378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:07.997657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.011490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 475/940] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:08.011490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.051434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:08.056286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.057429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.057899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.058399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.059539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.062100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.064570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING keystone.server.flask.common [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 21 10:23:08.087652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.sql.core [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 10:23:08.087652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 10:23:08.087652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [parameters: {'id': 'f33a167b3a2b43019d1601382721fa16', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 10:23:08.087652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80174) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f33a167b3a2b43019d1601382721fa16.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f33a167b3a2b43019d1601382721fa16. Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:23:08.100712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 21 10:23:08.102739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application yield resource Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise self.value Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application session.commit() Jun 21 10:23:08.104649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.flush() Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application compat.raise_( Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 10:23:08.107875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 10:23:08.110511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:23:08.112677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [parameters: {'id': 'f33a167b3a2b43019d1601382721fa16', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.115414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:08.117226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f33a167b3a2b43019d1601382721fa16. Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 466/941] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jun 21 10:23:07 2022] POST /identity/v3/projects => generated 262 bytes in 284 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:08.119337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.160917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:08.189950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f452e5f-0584-4807-9f2b-61f73236c827 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.258205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.259313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.259834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.260350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.262101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:08.264585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.264805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4fbff-62da-4997-84c8-dd67741409e6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.265111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.295761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 476/942] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:08.295761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.320762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.321671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.322122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.322603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.323625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] RBAC: Adding query filter params (interface=public, service_id=6b4c0becaada41608fa7b060ba1f4d8d, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:08.324068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.326076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.336929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 467/943] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/endpoints?service_id=6b4c0becaada41608fa7b060ba1f4d8d&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:08.338904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.437050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:08.468982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca972ea-ef14-4fc0-b51e-a9ad20fcaec9 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.480526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:08.497318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba9ffc-857e-4025-8e46-b23eb57a355c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.528305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.529588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.530084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.530547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.542292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.544753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.561176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.562884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.563584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.564352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:08.569600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:08.571456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 477/944] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:08.573216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.579935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.582983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:08.611634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:08.612741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:08.613758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:08.614515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 468/945] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:08.615609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.720676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5aad03-7e33-470e-9301-eee9c4759491 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.768633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.769895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.770619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.771106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.772432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.774219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.782605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 478/946] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/services => generated 1497 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:23:08.784144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:08.812316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e8afbb-dbd0-472a-89bc-a74cf8ed6d92 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:08.816337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:08.895885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:08.897170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:08.897722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:08.898992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:08.900677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:08.900839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:08.903957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:08.946302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 469/947] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:09.017893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972eef7e-8f37-4ab6-b55f-087037c4fd4b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:09.089235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:09.090914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:09.091698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:09.092443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:09.094424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:09.095323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:09.098523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cc6160-39ea-470b-bd1f-6cb3a14a4dbc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:09.127839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 479/948] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:09.138139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:09.165514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:09.308403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df36c2-868c-4fa0-adda-a5929e4616f6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:09.360662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:09.361602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:09.361882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:09.362197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ab0772e95f25425286c921316cc19411/roles/fd1ac0e38492413ca7539e39d538093e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:09.365076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=ab0772e95f25425286c921316cc19411, role_id=fd1ac0e38492413ca7539e39d538093e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:09.366596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28519570-b9db-4f4f-a34a-c7027e985357 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:09.390948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 470/949] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:23:09 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/ab0772e95f25425286c921316cc19411/roles/fd1ac0e38492413ca7539e39d538093e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:23:09.512402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80087-e30f-4e72-9f2c-606f23874fff None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:09.512672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80087-e30f-4e72-9f2c-606f23874fff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:09.513117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a80087-e30f-4e72-9f2c-606f23874fff None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:09.514777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 480/950] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:09.521309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:09.521576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:09.521879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:09.541862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:09.543394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:09.629150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 471/951] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:09.652649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80087-e30f-4e72-9f2c-606f23874fff None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:09.818957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:09.870871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a80087-e30f-4e72-9f2c-606f23874fff None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:09.941515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:09.942872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:09.943332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:09.943777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:09.944911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:09.947387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:09.969257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:09.970369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:09.971414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:09.972319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 481/952] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:09.978804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:09.982239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:10.176601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bf445-1d91-4cdf-a810-5d77981b9cf9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:10.234351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:10.235042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:10.235325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:10.235603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:10.236337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:10.236641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:10.238167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d458c0d4-3ff9-4f69-912f-3d51a9b8dd67 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:10.244310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 472/953] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:10.253117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:10.424514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a396091-c5d1-4a1e-9917-6cf01ec1c147 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:10.495085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:10.496104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:10.496584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:10.497060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:10.498373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:10.498926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:10.501584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cfb20f-3491-43d5-8015-dd54f9d1ce52 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:10.512179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 482/954] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:10.514248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:11.583243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4b61-bb51-4ba0-970c-4c0eea09e5ea None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:11.584128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4b61-bb51-4ba0-970c-4c0eea09e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:11.584128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd4b61-bb51-4ba0-970c-4c0eea09e5ea None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:11.585576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 473/955] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:11.591418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:11.592496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:11.592982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:11.614387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:11.616034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:11.708395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e65d4-5d9d-423e-8170-985d89692df4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:11.709352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e65d4-5d9d-423e-8170-985d89692df4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:11.710093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e65d4-5d9d-423e-8170-985d89692df4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:11.713201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 474/956] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:11.722402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:11.723256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:11.723756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 483/957] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:11.724148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:11.747685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:11.756589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:11.758922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:11.869352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:11.890536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 475/958] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:11.925051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c4c72-cc80-4875-a5ce-2a91604b9edf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:11.928674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:11.962710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:11.972209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:11.973337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:11.973608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:11.974045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:11.975064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:11.978258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:12.001863 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:12.003717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:12.004872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:12.007545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 484/959] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:12.016520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.128808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44abf09f-b739-4e94-b5d2-9c3d5ca426d2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.144626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f487c-a7e6-4060-9212-23b3b6ef2565 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.188885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.189695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.189983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.190292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.191286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:12.191602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.193027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.196924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.198253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.198899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.199521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.200940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.203435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 485/960] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:12.204033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.204373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.230146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.sql.core [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 10:23:12.230146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 10:23:12.230146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [parameters: {'user_id': '1f6c68fda45a4f0189e219144d28f4b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 10:23:12.230146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80174) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:23:12.253226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:23:12.255334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application yield resource Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application next(self.gen) Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.rollback() Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.force_reraise() Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise self.value Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application session.commit() Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 21 10:23:12.256890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._prepare_impl() Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.session.flush() Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._flush(objects) Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application compat.raise_( Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application flush_context.execute() Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rec.execute(self) Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 21 10:23:12.265809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 21 10:23:12.266970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result = self._query(query) Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application conn.query(q) Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application result.read() Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 21 10:23:12.267973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [parameters: {'user_id': '1f6c68fda45a4f0189e219144d28f4b8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:12.269132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 21 10:23:12.270480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 476/961] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jun 21 10:23:11 2022] POST /identity/v3/users => generated 160 bytes in 329 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:12.271539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.298517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:12.361894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa6cb0-eacd-4e4f-875a-b85c311e4308 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.372054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:12.416646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.417342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.417630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.418150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.419056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:12.419379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.421465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.427847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082aa476-eae6-4293-87b5-5ace302a6daf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.428452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 486/962] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:12.442405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.469267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.470444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.470880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.471322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.483316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.485533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:12.506917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:12.507963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 21 10:23:12.508936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:12.513940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 477/963] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:23:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:12.515095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.581256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025dc116-3d7c-4498-9799-54afa7704f96 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.605375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:12.624283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.624966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.625249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.625528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.626324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.628479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de388c7e-5295-42e5-a12e-4a2188747473 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.647105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40dd4f-1db9-44b1-8ba1-39acd13d4400 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:12.653026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 487/964] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:12.654784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dc30e-7e34-41d8-a18e-c07d2b4ff49f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.655290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dc30e-7e34-41d8-a18e-c07d2b4ff49f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.655906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3dc30e-7e34-41d8-a18e-c07d2b4ff49f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.657539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 488/965] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:12.664279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.664722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.665167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.676019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:12.689331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:12.691078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:12.724650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:12.725942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:12.726526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:12.727026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:12.728783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:12.729342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:12.732208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:12.802634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 478/966] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jun 21 10:23:12 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:12.835550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 489/967] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:12.860465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:12.996017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ef726-95da-4caa-9973-e80f2bc7f0c3 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:13.065124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:13.065124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.065638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.066027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.087072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:13.103726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:13.105606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:13.108105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 479/968] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:13.113324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:13.319830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e9530-286c-4d71-a868-086cb74249e0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:13.335130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:13.389167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:13.390281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.390722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.391148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.392412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:13.392897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:13.395465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b49671-7ada-459f-bb68-464d80e507cc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:13.412399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 490/969] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:13 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:13.420940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:13.490412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:13.557792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240a85-fb5b-44bd-9803-ed013d596c0f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.558076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240a85-fb5b-44bd-9803-ed013d596c0f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.558383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5240a85-fb5b-44bd-9803-ed013d596c0f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.559928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 491/970] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:13.565297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.565730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.566738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.588704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:13.590569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:13.609256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0893c1d-1339-4fba-9c93-fe71c6314ce8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:13.651278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:13.652836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.653286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.653566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.667031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:13.668681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:13.673749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 492/971] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:13.696816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:13.697776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:13.698886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:13.698886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:13.698886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:13.698886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:13.699119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:13.701386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 480/972] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:13.709851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:13.830126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:13.838039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:13.840713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20e471-c86e-48a1-8560-0d3a4a41b9b0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:13.867195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f371104-5698-4ca9-ba97-7742c231d52b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:13.881978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:13.882691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.882972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.883318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.884054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:13.885473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:13.901292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 493/973] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:23:13 2022] POST /identity/v3/services => generated 242 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:13.929325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:13.930019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:13.930355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:13.930627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:13.931405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:13.931702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:13.933152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:13.954571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 481/974] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:13.956348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:14.117542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1e6e1-ce3c-4259-980e-041bc6be8753 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:14.169842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:14.171311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:14.171795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:14.172224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:14.186485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:14.189361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:14.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:14.219449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:14.221180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 494/975] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:23:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:14.225715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:14.367859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40421a14-d34f-4319-b83d-3de2c2576cff None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:14.429401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:14.430625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:14.431153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:14.431719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:14.433431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:14.433864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:14.436669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:14.453029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:14.472155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 482/976] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jun 21 10:23:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:14.481417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:14.514104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:14.632378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e9be-f944-4eaa-9a22-2f5a144f049e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:14.670586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:14.671423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:14.671830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:14.672259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:14.750626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:14.752536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221dc6f-9494-4e50-8d6f-8b17ddfbb0b5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:14.774728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:14.888875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 495/977] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:14 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:23:14.896535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.007073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22068ac-31c8-4ab5-9f31-dfa39f6731d0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.007388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22068ac-31c8-4ab5-9f31-dfa39f6731d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.007707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22068ac-31c8-4ab5-9f31-dfa39f6731d0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.010457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 496/978] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:15.015103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.015483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.015679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.033213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:15.035033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:15.055823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebbd292-5cf5-493b-ba48-6d0d7c68a0b6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.094682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.095666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.095939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.096213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.108760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.110608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:15.134378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:15.135744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:15.136924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:15.136924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:15.136924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:15.136924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:15.137292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 497/979] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:15.140907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 483/980] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:15.142498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.164849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.207337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:15.240397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:15.286827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe95e85-65aa-4994-9b58-564ee606a3da None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.325188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.325423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cca355-263a-4ff0-94ed-13d570e45248 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.325825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.326172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.326445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.327175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:15.328108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.328973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.349990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 498/981] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:15.358439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.392155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.393823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.394078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.394531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.395802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.397900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:15.415212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:15.416317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:15.417308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 484/982] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:15.426575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.494391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192401e-8ab7-4f4e-ba02-cb87520371be None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.506009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:15.547153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.548773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.548993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.549248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.562788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.565536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.585735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f4b18-e9eb-4c8d-a712-8159f42878c2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:15.593079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:15.594127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:15.595691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:15.597773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 499/983] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:15.604446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.613822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:15.648834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.649711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.650266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.650758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.652148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:15.652786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.655516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.664873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 485/984] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:15.672026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.779833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5100b8be-5137-4587-999b-56236190bd8c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.845962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.846858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.847827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.848101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.848942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:15.849244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.850808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.856705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f2b07f-15da-4b42-9479-9fba17204758 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:15.865947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 500/985] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:15.872005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:15.916636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:15.929375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:15.930592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:15.931045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:15.931514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:15.932755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:15.933317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:15.936022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:15.946547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 486/986] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:15.954820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:16.038857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:16.050210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a846663-9a19-4549-a572-780d74851f3e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:16.090654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:16.091333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.091618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.091897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.092746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] RBAC: Adding query filter params (role.id=fd1ac0e38492413ca7539e39d538093e, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=ab0772e95f25425286c921316cc19411) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:16.093061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:16.094601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2483d99-2738-4098-8b77-d0aef26a1633 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:16.103325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 501/987] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/role_assignments?user.id=ab0772e95f25425286c921316cc19411&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fd1ac0e38492413ca7539e39d538093e => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:16.104668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140129-f435-485e-857d-2fa8f771c8ff None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.104955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140129-f435-485e-857d-2fa8f771c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.105731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140129-f435-485e-857d-2fa8f771c8ff None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.107280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 502/988] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:16.113006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.113324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.113596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.133119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:16.134514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:16.162391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab9e51-295d-4ee7-bb10-8cf685de0f7e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:16.223847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:16.224628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.225034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.225457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.226524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] RBAC: Adding query filter params (interface=admin, service_id=6b4c0becaada41608fa7b060ba1f4d8d, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:16.226989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:16.228938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:16.241356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 487/989] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Jun 21 10:23:15 2022] GET /identity/v3/endpoints?service_id=6b4c0becaada41608fa7b060ba1f4d8d&interface=admin®ion_id=RegionOne => generated 193 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:16.243049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:16.270573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 503/990] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:16.295110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:16.336679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:16.411873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86b053-927e-441c-848d-ca8e36d11456 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:16.420703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:16.456365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:16.457176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.457458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.457734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.458509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:16.460022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:16.466328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f424065-ab89-4af9-9965-119550a965f8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:16.478191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 488/991] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:16 2022] GET /identity/v3/services => generated 1727 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:23:16.536800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:16.538285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.538768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.539234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.540515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:16.543210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:16.566671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:16.568373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:16.569652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:16.574576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 504/992] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:16.578642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:16.755373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec07afd-ba59-4932-87f0-b06da2508d18 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:16.815498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:16.816631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:16.817106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:16.817583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:16.818926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:16.819460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:16.822067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:16.836430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 489/993] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:16.838883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:16.998033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:17.024756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ffaa9-d40a-4a8d-b98f-2c4a0c3dca78 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:17.084899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:17.085994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:17.086473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:17.086924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:17.088191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:17.088753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:17.091310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:17.101207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 505/994] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:17.111032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:17.176907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:17.314478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93defc25-b86d-4e1d-a897-e07d40cdf0e1 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:17.378935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:17.380012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:17.380510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:17.380983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:17.382555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] RBAC: Adding query filter params (interface=public, service_id=b8ab12c5abf047ba9b7ffeb3172ce4b2, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:17.383096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:17.385777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3f06ea-9d3e-42f5-81fa-b9e8b2827735 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:17.402163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 490/995] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:23:17 2022] GET /identity/v3/endpoints?service_id=b8ab12c5abf047ba9b7ffeb3172ce4b2&interface=public®ion_id=RegionOne => generated 194 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:17.405400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:17.567123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d0b64-9fcc-4ad9-83bb-1795372f142c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:17.604083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:17.604768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:17.605049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:17.605323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:17.606016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:17.607476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b84f97-28f7-4501-b129-796603a7d7aa None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:17.615364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 506/996] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:17 2022] GET /identity/v3/services => generated 1727 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:23:18.754231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da4d0-baeb-42ab-a286-c6c0d62c4d2c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:18.754973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da4d0-baeb-42ab-a286-c6c0d62c4d2c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:18.754973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852da4d0-baeb-42ab-a286-c6c0d62c4d2c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:18.756558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 491/997] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:18.763308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe334-e105-4d3b-9474-105ad4f67493 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:18.763941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe334-e105-4d3b-9474-105ad4f67493 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:18.764531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59fe334-e105-4d3b-9474-105ad4f67493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:18.792733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f59fe334-e105-4d3b-9474-105ad4f67493 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:18.794595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f59fe334-e105-4d3b-9474-105ad4f67493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:18.812124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:18.915312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 507/998] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:18.954936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852da4d0-baeb-42ab-a286-c6c0d62c4d2c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.026572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613e4fa-3b70-4efb-81d4-3e2c9c296462 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.026992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613e4fa-3b70-4efb-81d4-3e2c9c296462 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.027380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613e4fa-3b70-4efb-81d4-3e2c9c296462 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.029084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 508/999] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:19.037860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.038696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.039172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.070844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:19.072800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:19.090045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:19.098443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852da4d0-baeb-42ab-a286-c6c0d62c4d2c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.149181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.150239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.150551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.150804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.151473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.153419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:19.168985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:19.171397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:19.173046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 492/1000] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jun 21 10:23:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:19.180850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.190134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 509/1001] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:19.224468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.345738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:19.369933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ea73c-3949-41d4-b018-31bd5b63e166 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.389090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24e71d4-eea3-474b-9061-b5983199b5b2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.430874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.431928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.432339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.432788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.433943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:19.434488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.436914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.453664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 493/1002] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:19.456497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.460628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.461693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.462170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.462671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.463409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.465216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:19.485453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:19.487816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:19.489478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:19.494323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 510/1003] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jun 21 10:23:19 2022] GET /identity/v3/services/image => generated 86 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:19.496472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.517222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:19.649382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f13ec6-20ec-4d69-bc8f-622ae0b14b68 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.669558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81af4b1-1e84-4423-8e3b-cf46c361f2f4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.715328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.716200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.716614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.717041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.717844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:19.718258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.719842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.732917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 494/1004] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jun 21 10:23:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:19.734567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.738129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.739223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.739664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.740095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.741237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:19.741589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.743887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfeafb8-2f1e-4589-8140-51e600b2a8c6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.752396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 511/1005] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:19.754342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c524b-0c2d-4749-ab8b-2d2328234af4 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.754801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c524b-0c2d-4749-ab8b-2d2328234af4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.755245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c524b-0c2d-4749-ab8b-2d2328234af4 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.757513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 512/1006] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:19.759822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c524b-0c2d-4749-ab8b-2d2328234af4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:19.763324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:19.846298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:19.857973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c4860-0a81-4c2f-9dcd-63324892cd4e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:19.894167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:19.894933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.895255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.895535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.896334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:19.897752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6953e8de-85a0-4521-86de-57d5336825f5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:19.923616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 495/1007] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:19.923616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531bf3-e658-481c-9182-cf785020deab None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:19.923616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531bf3-e658-481c-9182-cf785020deab None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:19.923616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0531bf3-e658-481c-9182-cf785020deab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:19.937770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c0531bf3-e658-481c-9182-cf785020deab None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:19.939556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c0531bf3-e658-481c-9182-cf785020deab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:19.947809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c524b-0c2d-4749-ab8b-2d2328234af4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:20.013496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:20.014610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:20.015049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:20.015494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:20.016690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] RBAC: Adding query filter params (type=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:20.017180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:20.019802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:20.028171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 513/1008] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:20.060860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 496/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:19 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:20.097506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:20.213841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:20.302905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680d916-4437-4974-b1f5-51d3c4267c9f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:20.375421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:20.376818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:20.377279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:20.377731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:20.379278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:20.381904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:20.405899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:20.408015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:20.409683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 514/1010] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:20.416325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531bf3-e658-481c-9182-cf785020deab None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:20.512802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:20.539418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0531bf3-e658-481c-9182-cf785020deab None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:20.581119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:20.581788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:20.582123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:20.582373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:20.583089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:20.583399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:20.584810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:20.591005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 497/1011] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:20.596864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:20.799722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9a50-e489-4958-af30-313473d44b41 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:20.850079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:20.869816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:20.871074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:20.871586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:20.872085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:20.873478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:20.874182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:20.876733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1691405a-8e9d-49d5-93ef-cbcdbd948b18 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:20.894179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 515/1012] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jun 21 10:23:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:20.898180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:21.091354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac0207c-60a3-4e81-a1e1-6924ffd48530 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:21.159806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:21.160938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:21.161419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:21.161893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:21.163321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:21.165876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437989d-4a20-47ef-b6bf-da548b2e38d5 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:21.190307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:21.205227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 498/1013] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:22.350366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde65d-4248-48eb-84ab-a604978ff8bc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:22.350940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde65d-4248-48eb-84ab-a604978ff8bc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:22.351323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fde65d-4248-48eb-84ab-a604978ff8bc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:22.354296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 516/1014] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:22.360364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c066f-61f6-4fb3-9b58-51e82c27db3c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:22.361161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c066f-61f6-4fb3-9b58-51e82c27db3c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:22.361161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5c066f-61f6-4fb3-9b58-51e82c27db3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:22.380266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9d5c066f-61f6-4fb3-9b58-51e82c27db3c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:22.381484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9d5c066f-61f6-4fb3-9b58-51e82c27db3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:22.524003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 499/1015] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:22.562945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde65d-4248-48eb-84ab-a604978ff8bc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:22.751878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fde65d-4248-48eb-84ab-a604978ff8bc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:22.819460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:22.820495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:22.820975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:22.821469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:22.822873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:22.825420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd3d70-49ff-4bf9-a55e-f1b02bac2265 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:22.851248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 517/1016] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:23:22 2022] POST /identity/v3/services => generated 242 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:22.923682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764177-658e-4912-ba6b-67dbf7fcc62b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:22.924180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764177-658e-4912-ba6b-67dbf7fcc62b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:22.924567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c764177-658e-4912-ba6b-67dbf7fcc62b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:22.926532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 500/1017] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:22.933576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:22.934103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:22.934509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:22.959073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:22.960646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:23.024245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:23.068359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 518/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:23.095238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c764177-658e-4912-ba6b-67dbf7fcc62b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:23.290613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c764177-658e-4912-ba6b-67dbf7fcc62b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:23.340741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:23.356890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:23.358210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:23.358717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:23.359211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:23.361392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:23.364264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282b5a8f-bee2-437b-8032-0ce371a62b23 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:23.367707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 501/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:23.377259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:23.524894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b42dc1-bd22-405b-80db-a0b896a9363e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:23.566567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:23.567558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:23.567966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:23.568376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:23.569278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:23.570972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3827e7e2-63b9-4fbf-a691-c2984e298b41 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:23.606605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 519/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:23:23 2022] POST /identity/v3/projects => generated 311 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:24.081357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af7d4-2f18-41a1-96ca-0cc8795484f7 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:24.081920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af7d4-2f18-41a1-96ca-0cc8795484f7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:24.082371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709af7d4-2f18-41a1-96ca-0cc8795484f7 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:24.085086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 502/1021] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:24.093890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:24.094424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:24.094904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:24.123979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:24.126018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:24.169735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:24.261828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 520/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:24.304225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709af7d4-2f18-41a1-96ca-0cc8795484f7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:24.492315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709af7d4-2f18-41a1-96ca-0cc8795484f7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:24.552966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:24.553839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:24.554147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:24.554422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:24.573494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:24.590096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:24.591260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:24.592213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:24.593603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 503/1023] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:24.602560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:24.782658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b0ded-c88f-4db6-a27c-5597307d6ba6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:24.851846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:24.853364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:24.853824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:24.854325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:24.855695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:24.856232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:24.858867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:24.881077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 521/1024] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:24.883008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:24.951607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:25.013146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac94c9-98ed-494d-a0a1-c955767e97e2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:25.056203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:25.057030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.057304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.057582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.071070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:25.072641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:25.092266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:25.094127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:25.095949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:25.095949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:25.095949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:25.095949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:25.098180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 504/1025] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:25.100402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:25.142577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:25.292624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe083967-cee7-4571-9a27-f11f6480cee0 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:25.358217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:25.359172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.359657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.360126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.361440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:25.361955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:25.364492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:25.394116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 522/1026] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:25.397890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:25.591035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6a066-e64d-4152-8de0-a79dfec5c561 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:25.605946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:25.660070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:25.661241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.661738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.662283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.678291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:25.681109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-446a81dd-d2d7-4770-95ea-6df48bd8a0e4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:25.709692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:25.711920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:25.713835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 505/1027] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:23:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:25.725550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:25.739194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e7b8-75d7-480b-9783-e82aee9ef692 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.739679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e7b8-75d7-480b-9783-e82aee9ef692 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.740164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73e7b8-75d7-480b-9783-e82aee9ef692 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.742792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 506/1028] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:25.749611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.750111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.750622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.781546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:25.783718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:25.841551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:25.869145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19a6478-185c-4230-bd53-0488187caa7f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:25.912012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:25.912603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:25.912916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:25.913274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:25.914184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:25.914495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:25.916020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:25.928566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 507/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:25.952322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:25.956111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 523/1030] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:23:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:25.964639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.104047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd20322a-ad6c-4964-9cdf-fa715d2ce973 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.121557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.131573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7bb2cd-54ab-4d91-b29f-28a28b205d84 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.171480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.172501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.172985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.173476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.176601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.177573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.177983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.178742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.179520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.181683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.191127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:26.196201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:26.198255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:26.199857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:26.205129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 508/1031] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jun 21 10:23:25 2022] GET /identity/v3/services/image => generated 86 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:26.206819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.312294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.314811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.369844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d110e3-a730-4d8d-8edd-1e9698beeec7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.411748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.412765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.413182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.413582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.414661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] RBAC: Adding query filter params (name=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:26.415107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.416859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.428830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 509/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:26.430459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.463409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.474417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 524/1033] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:23:26.480547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.532442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.564420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc53c95-691e-42aa-a3a0-4eda212afabd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.609472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.610272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.610485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.610617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60b748e-d18f-485c-9db6-1120a818807c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.610752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.611491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] RBAC: Adding query filter params (type=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:26.611806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.613326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f7fbe-43ee-4a73-854f-d51590dcbd42 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.619036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 510/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:26.620435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288eaa4-7a90-43d8-a788-afabcc676f6f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.620722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288eaa4-7a90-43d8-a788-afabcc676f6f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.621046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288eaa4-7a90-43d8-a788-afabcc676f6f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.622720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 511/1035] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:26.626271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288eaa4-7a90-43d8-a788-afabcc676f6f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.656212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.657021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.657299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.657568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.669249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.670792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-892f3bee-073f-4559-b0ee-a77db62b7f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:26.689967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:26.691767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 525/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.693561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.711656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:26.712904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:26.738141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.752558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288eaa4-7a90-43d8-a788-afabcc676f6f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.788788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 526/1037] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:26.789602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.798621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.799920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.800431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.800926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.802561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] RBAC: Adding query filter params (interface=public, service_id=74c1e5088a51425f94c3bf300705e094, region_id=RegionOne) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:26.803131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.805857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.814773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:26.816338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 512/1038] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/endpoints?service_id=74c1e5088a51425f94c3bf300705e094&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:26.823311 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.914801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b753a70-b2a9-4259-ae5d-2fa8638c6e97 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.956068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebde98-86a1-49cb-805c-313297873e56 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:26.961946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.962741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.963094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.963443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.964330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:26.964761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.966373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:26.979327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 527/1039] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:26.980206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:26.995287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:26.996269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:26.996653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:26.997062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:26.997878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:26.999573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.007925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 513/1040] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/services => generated 1957 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:23:27.008691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:27.032254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:27.098529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:27.126611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbac16-d9b4-4ec8-805d-443b141a88eb None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:27.156413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed484ad-bafb-4863-82c9-05bab09b08a8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:27.180364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:27.181965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:27.181965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:27.181965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:27.184157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:27.185621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.187713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 528/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:27.194744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:27.221021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:27.222641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:27.223143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:27.223637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:27.236921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:27.239737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:27.267124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:27.268169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:27.269873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:27.274480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 514/1042] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:27.278998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:27.349325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5d709-9b7b-437d-b3ce-a043892c2f64 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:27.402245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:27.410182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:27.411015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:27.411425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:27.411710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:27.412666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:27.415458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.436983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079ff27-6e59-4584-bda8-8244e8c9b274 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:27.447695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 529/1043] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:23:27 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:23:27.490440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:27.491022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:27.491295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:27.491562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:27.492414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:27.492720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:27.494276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049d2c3-4b02-475a-b54f-af5e08a5f535 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.509947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 515/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:27.516439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:27.521269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:27.707578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc439b28-073c-4467-b1ba-b1bd3814aced None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:27.767007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:27.768013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:27.768531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:27.769031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:27.770959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] RBAC: Adding query filter params (role.id=fd1ac0e38492413ca7539e39d538093e, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:27.771527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:27.774513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56139af3-e6ad-475b-9427-ab1304d6c898 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:27.785223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 530/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:27 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fd1ac0e38492413ca7539e39d538093e => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:29.215698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d96b-796c-4079-9255-0094481b7a72 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.216289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d96b-796c-4079-9255-0094481b7a72 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.216647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540d96b-796c-4079-9255-0094481b7a72 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.219296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 516/1046] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:29.225276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.226241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.226241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.244988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:29.246246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:29.329003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:29.342596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 531/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:29.361911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540d96b-796c-4079-9255-0094481b7a72 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:29.539783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540d96b-796c-4079-9255-0094481b7a72 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:29.581723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:29.583349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.584039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.584715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.586096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:29.588855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:29.593889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:29.614221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:29.615317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 21 10:23:29.616171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:29.617591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 517/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jun 21 10:23:29 2022] GET /identity/v3/services/image => generated 86 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:29.625610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:29.751087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40febb-35fd-468a-9856-f010328f8e18 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:29.790717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:29.791485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.791892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.792289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.793141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] RBAC: Adding query filter params (name=image) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:29.793579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:29.795168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0724361-7608-4238-8e1f-fda9bffb8e63 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:29.806015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 532/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:29.811184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:29.922487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278123-3eb7-4d2b-9f40-ad622eff2a94 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.922978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278123-3eb7-4d2b-9f40-ad622eff2a94 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.923441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57278123-3eb7-4d2b-9f40-ad622eff2a94 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.926861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 533/1050] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:29.935097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:29.935506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:29.935985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:29.951743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64820a92-546c-4a43-a663-2678e160cba6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:29.957541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:29.958973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:30.015404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:30.016566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.017068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.017565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.019080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] RBAC: Adding query filter params (type=image) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:30.019633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:30.022252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:30.029666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:30.032181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 518/1051] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:30.039021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.051268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 534/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:30.078372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.144927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:30.219306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cf785c-cded-425a-9663-64f1f0ce2b53 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:30.253753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92929a32-1a71-4942-beae-b3b7634128d0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:30.283029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:30.283700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.284049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.284317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.285358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:30.287391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:30.313786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 519/1053] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:23:30 2022] POST /identity/v3/endpoints => generated 327 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:30.327878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:30.328703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.328976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.329295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.342679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:30.350948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:30.353120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:30.356046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:30.359761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 535/1054] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:30.360157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.489080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fd4d-c92e-4f27-9e40-547e3fc0972f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:30.514120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:30.534319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:30.535063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.535448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.535735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.536531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:30.536840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:30.538331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a45c4a-477f-4228-8842-3ab2934942c2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:30.549512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 520/1055] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:30.555795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.642319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:30.735375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c65e59-9981-47c9-8e12-26911e663d7a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:30.778813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:30.779414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.779689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.779957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] PATH_INFO: `/v3/users/c9d02d7a336344d18eacfe8e105334d2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.781437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296ff6-06c9-49dc-8cb0-6d96dd449e5a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.781926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296ff6-06c9-49dc-8cb0-6d96dd449e5a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.782453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296ff6-06c9-49dc-8cb0-6d96dd449e5a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.786116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 521/1056] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:30.793359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:30.793761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:30.793918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:30.798315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d02d7a336344d18eacfe8e105334d2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:30.799841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:30.802371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 536/1057] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:30 2022] GET /identity/v3/users/c9d02d7a336344d18eacfe8e105334d2 => generated 285 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:30.808134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.827485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:30.829593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:30.944039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 522/1058] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:30.959836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff68e9-9e44-45d2-a1b1-f901bcd66736 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:30.970375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:30.975260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.026237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.027128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.027536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.027989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.108602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fdfc74-b738-492b-9882-68b633a593f9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.126339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.157417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.160205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.165827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.167266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.167713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.168161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.189179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:31.204150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:31.205978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:31.207613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 523/1059] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:31.214869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:31.335729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 537/1060] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 10:23:31.338334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:31.352897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.363888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715160e0-a820-4f3a-b9a6-2e47ab41e577 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.417513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.418329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.418667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.418932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.419888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:31.420051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.421347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.437127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 524/1061] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:31.445399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:31.490895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.511688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b1e91c-6d08-4da4-9ac9-355297b89215 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.567525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.568492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.568772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.569313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.570721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.572242 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.574379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 538/1062] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:31.581336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:31.603370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fe5a2-bde2-405c-b0e0-7515e500a852 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.661405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.662954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.663524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.664089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.680474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.685240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.686865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:31.707041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:31.708048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:31.709044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:31.709044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:31.709044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:31.709044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:31.709044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 525/1063] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:31.714460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:31.717031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51464468-6989-4309-b7ba-58fdf75baee5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.757483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.758106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.758390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.758665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.759626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=837244c064cb4118ac687903ed43b751, user.id=c9d02d7a336344d18eacfe8e105334d2) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:31.759950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.761558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.768957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 539/1064] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/role_assignments?user.id=c9d02d7a336344d18eacfe8e105334d2&scope.project.id=837244c064cb4118ac687903ed43b751&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:31.880884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:31.904077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7c51e-212a-48c4-a9d1-8ae9b21a381a None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:31.956790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:31.957601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:31.957902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:31.958213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:31.958996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:31.959320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:31.960810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:31.977429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 526/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:31.984018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:32.192083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3654b-7464-478e-b9c5-bc3b5ca2bb77 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:32.273382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:32.274916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:32.276276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:32.276276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:32.292348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:32.295628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:32.299569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-1bf7aceb-5e97-4ef5-b42f-d027ec46634b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:32.318885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:32.320980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:32.323170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:32.333090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 540/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:23:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:32.334699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:32.531787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cee514-7f81-425f-bfa2-1619ef261990 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:32.598274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:32.599465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:32.599964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:32.600454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:32.602471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:32.603000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:32.605633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff19a4ab-1261-4053-9ceb-de74c8b17112 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:32.654112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 527/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:23:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:32.654389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fa5c-2149-4b67-9973-23405c26e201 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:32.654389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fa5c-2149-4b67-9973-23405c26e201 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:32.654389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552fa5c-2149-4b67-9973-23405c26e201 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:32.654389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 541/1068] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:32.660483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:32.660483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:32.660483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:32.661023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fa5c-2149-4b67-9973-23405c26e201 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:32.666677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:32.680714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:32.682283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:32.806000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 528/1069] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:32.843748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:32.850112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552fa5c-2149-4b67-9973-23405c26e201 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:32.913431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:32.914753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:32.915203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:32.915646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:32.934079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:32.936852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:32.970495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:32.971738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:32.972816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:32.972816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:32.972816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:32.972816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:32.973236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 542/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:32.980996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.007570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a7cd9-a757-4fdf-b77a-aad05e2b1ffe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.064037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.074988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.075859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.076320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.076759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.084678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.153528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd8ac1f-fd47-427b-aad6-6687a8ceb155 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.201544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.203652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.213671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.214743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.215198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.215644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.216871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:33.217366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.219426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.239921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 543/1071] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:33.246078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.398355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 529/1072] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 10:23:33.404561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.407761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b5f3-4127-4de0-9b47-a63545035d6c None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.425203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.458659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.459654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.460121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.460546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.463043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.474470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.476442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:33.501126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:33.504345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:33.506208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 544/1073] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:33.510651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.590831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12a3fa-39ad-43c7-aaca-31d367ca95bc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.648886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.650036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.650516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.650925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.668654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.671499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.692150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36a65af-eb5f-45d2-a687-128ca635c72e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:33.693659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:33.695537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:33.696704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:33.696704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:33.696704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:33.696704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:33.696704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 530/1074] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:33.705727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.753164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.754354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.754782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.755185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.756363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:33.756879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.759216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.778523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 545/1075] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:33.782490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:33.821780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.854542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:33.882402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad4ede4-fdbb-4003-be99-4210cafd2946 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.941094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de0448-c31d-4a5b-9ed6-95223fda3cc8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:33.950027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:33.951167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.951649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.952146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.953536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:33.954114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:33.957625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fece3a2-b646-4e6c-8517-59ef27a7d6c2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:33.981608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 531/1076] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:33.984053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a596565-c107-4a76-abd9-6e4e0babd7c4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.984563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a596565-c107-4a76-abd9-6e4e0babd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.985065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a596565-c107-4a76-abd9-6e4e0babd7c4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:33.987823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 532/1077] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:33.994011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:33.994363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:33.994646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.008440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:34.010216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:34.010732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:34.011208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/fd1ac0e38492413ca7539e39d538093e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.013661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:34.015001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:34.015595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=a43c2cee600846c99e25b81e21726370, role_id=fd1ac0e38492413ca7539e39d538093e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:34.019132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:34.044242 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 546/1078] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:23:33 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/a43c2cee600846c99e25b81e21726370/roles/fd1ac0e38492413ca7539e39d538093e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:23:34.140834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 533/1079] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:34.180367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:34.332430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:34.345428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4526a08-ad87-470e-9ef5-5aaeb2287e34 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:34.385431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:34.386277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:34.386549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:34.386829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.399571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:34.407162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:34.408275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:34.409902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 547/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:34.418384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:34.530516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:34.557349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d85634-3d6c-4cdb-9729-384323299ad6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:34.608728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:34.611487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:34.611487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:34.611487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.612031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:34.612561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:34.615330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:34.631295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 534/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:23:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:34.640065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:34.755602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e868dcb-2855-4006-bf34-cc95afe89ccf None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:34.801604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:34.802534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:34.802808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:34.803116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] PATH_INFO: `/v3/users/c9d02d7a336344d18eacfe8e105334d2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.804327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] RBAC: Authorizing `identity:get_user(user_id=c9d02d7a336344d18eacfe8e105334d2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:34.805777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:34.807478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 548/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:34 2022] GET /identity/v3/users/c9d02d7a336344d18eacfe8e105334d2 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:34.813566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:34.929853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f41048-76db-4be7-b317-4170dcd3f025 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:34.968338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:34.969846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:34.970370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:34.970849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:34.973236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:34.975887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c559afd5-adf6-4f86-a538-f133a949e7aa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:34.979324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 535/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:34 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:34.985923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:35.006079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:35.101382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3844b570-98a1-4dff-b544-c3bb178dd56a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:35.148812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:35.149949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:35.150326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:35.150525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751/users/c9d02d7a336344d18eacfe8e105334d2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:35.153919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] RBAC: Authorizing `identity:create_grant(project_id=837244c064cb4118ac687903ed43b751, user_id=c9d02d7a336344d18eacfe8e105334d2, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:35.156322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47218443-1219-40d5-9af2-f10d5f10a086 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:35.175487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 549/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:23:34 2022] PUT /identity/v3/projects/837244c064cb4118ac687903ed43b751/users/c9d02d7a336344d18eacfe8e105334d2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:23:36.236289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eedd6-825f-4b86-b599-3f97980c74cb None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:36.236878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eedd6-825f-4b86-b599-3f97980c74cb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:36.237258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468eedd6-825f-4b86-b599-3f97980c74cb None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:36.239854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 536/1085] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:36.246628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626553-632a-4189-9a72-1a8146120e88 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:36.247173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626553-632a-4189-9a72-1a8146120e88 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:36.247600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54626553-632a-4189-9a72-1a8146120e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:36.276649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-54626553-632a-4189-9a72-1a8146120e88 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:36.278673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-54626553-632a-4189-9a72-1a8146120e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:36.365143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 550/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:36.390704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eedd6-825f-4b86-b599-3f97980c74cb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:36.408097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:36.571832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468eedd6-825f-4b86-b599-3f97980c74cb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:36.630164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:36.631425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:36.631815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:36.632189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:36.648672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:36.664216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:36.666271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:36.667541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 537/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jun 21 10:23:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:36.675579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626553-632a-4189-9a72-1a8146120e88 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:36.686838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:36.792128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54626553-632a-4189-9a72-1a8146120e88 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:36.831311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:36.831980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:36.832321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:36.832657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:36.833495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:36.833862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:36.835392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:36.845289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 551/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:23:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:36.852358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:36.966826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.028368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4296ce-a7db-458e-934c-44776c8d4527 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.093394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.094302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.094669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.095045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.107954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:37.109587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-2e615a4e-3cbb-4fc3-abab-5bec9b633d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:37.129725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:37.131595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:37.133284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:37.133284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:37.133284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:37.133284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:37.133284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 538/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:37.139046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.228031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.287108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9079a5d-a5e2-4bda-b1c7-2f85b027656e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.348505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.349571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.350038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.350528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.351707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:37.352533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:37.354889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56db96c2-baa0-43f3-b97c-453247d47045 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:37.376974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 552/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:37.377348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018963f3-c156-42d0-b272-365d86a2eb1c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.378173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018963f3-c156-42d0-b272-365d86a2eb1c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.378364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018963f3-c156-42d0-b272-365d86a2eb1c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.381004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 539/1091] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:37.386917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018963f3-c156-42d0-b272-365d86a2eb1c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.395942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.396305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.396581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.420035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:37.421426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:37.512353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 553/1092] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 21 10:23:37.521636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018963f3-c156-42d0-b272-365d86a2eb1c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.540147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.543088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.563342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.564153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.564434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.564713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.573591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:37.575337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:23:37.598240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:37.600011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:37.601798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 540/1093] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:37.610306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.627814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.693340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c5e1d-2528-4322-83e4-0ba060b381db None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.733930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.734789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.735069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.735345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.749111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:37.757863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6daf224-4b5f-4f93-a21b-3fb6b497ad3c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:37.762378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:37.764340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:23:37.765292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 554/1094] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:37.773833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.819867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.820678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.821069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.821433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.822459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:37.822861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:37.824593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:37.845948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 541/1095] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:37.854948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:37.899732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.907824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2bd7f5-c7a1-4604-82c9-ee6e9cd716df None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.935761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:37.959028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:37.960221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:37.960583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:37.961052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:37.962457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:37.962986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:37.965524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:37.981937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 555/1096] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:37.987261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af94d078-fb6b-4763-901b-8a5b2f8b3978 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:37.991068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.027487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.028505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.029003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.029488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.119966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8967ece9-fb04-48ba-afd3-4ef21f223610 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.133369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.135337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.165608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.166797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.167148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.167555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] PATH_INFO: `/v3/users/c9d02d7a336344d18eacfe8e105334d2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.169093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] RBAC: Authorizing `identity:get_user(user_id=c9d02d7a336344d18eacfe8e105334d2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.170910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.173153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 556/1097] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/users/c9d02d7a336344d18eacfe8e105334d2 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:38.179782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.180094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.246315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.282580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 542/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 10:23:38.289436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.318395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3ec44-cf61-49a1-bccc-790db52e03e3 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.359120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.359784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.360065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.360338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.413003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d6631-bc44-453c-9243-4f5be5a783a9 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.452285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.454268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.455591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.456526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.456998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.457501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.461059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.473034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.475609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:23:38.498444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:38.500386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:38.501466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:23:38.501466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:23:38.501466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:23:38.501466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:38.501466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 543/1099] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:38.507622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.521512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.590925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 557/1100] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 10:23:38.592948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.646094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68de5-7e6a-4a8a-8b30-8e28cc49d5cc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.694474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.695293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.695697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.696045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.696871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:38.697246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.698788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.713659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 544/1101] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:38.719713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.748140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1f659-3f77-477f-9bd6-d1d1dfe418a4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.779988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.805728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.806823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.807223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.807628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.809213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.811395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.813486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 558/1102] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:38.820562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:38.847459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:38.865138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81853981-9113-43f5-bad1-3109fc64fe58 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.924977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:38.925973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:38.926405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:38.926794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:38.937183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:38.939690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:38.946159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836c485-75c2-4b6f-a839-098384bd964e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:23:38.965778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:38.967259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:38.968372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 545/1103] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:23:38.974600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:39.008497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:39.009642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:39.010129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:39.010582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:39.011988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=837244c064cb4118ac687903ed43b751, user.id=c9d02d7a336344d18eacfe8e105334d2) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:39.012494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:39.014873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:39.034352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 559/1104] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/role_assignments?user.id=c9d02d7a336344d18eacfe8e105334d2&scope.project.id=837244c064cb4118ac687903ed43b751&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:39.105537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa7b44-73bd-4a03-a847-15e8daa0a87f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:39.117500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:39.151523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:39.152319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:39.152654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:39.152990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:39.153877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:39.154294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:39.155906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366fd7a-29a3-41f4-9bc0-3747415a11c8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:39.170614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 546/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:23:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:23:39.177419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:39.280127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:39.301113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec6dca-ad52-4751-9467-f71257b58d52 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:39.341447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:39.342547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:39.342547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:39.342878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:39.343514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] RBAC: Adding query filter params (role.id=fd1ac0e38492413ca7539e39d538093e, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=a43c2cee600846c99e25b81e21726370) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:39.343825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:39.345308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1926814-3f70-4b47-8101-e4c7f23c964c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:39.352972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 560/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:39 2022] GET /identity/v3/role_assignments?user.id=a43c2cee600846c99e25b81e21726370&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fd1ac0e38492413ca7539e39d538093e => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:41.227796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b3ae-2d68-44b0-8484-96235817cfd1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:41.228384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b3ae-2d68-44b0-8484-96235817cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:41.228384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db6b3ae-2d68-44b0-8484-96235817cfd1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:41.229987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 547/1107] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:41.236357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:41.240202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:41.240202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:41.256445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:41.257652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:41.348500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 561/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:41.374845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b3ae-2d68-44b0-8484-96235817cfd1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:41.497117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db6b3ae-2d68-44b0-8484-96235817cfd1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:41.535693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:41.536502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:41.536785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:41.537056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:41.538532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:41.540015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012a25c-5dbe-45ea-8a1e-5ee559c27d39 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:41.541712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 548/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:41.548046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:41.640346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:41.668794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351bd64-c1ee-46ce-81ce-41fe9652d63b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:41.709807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:41.710624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:41.710949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:41.711267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:41.712067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:41.713620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577982c7-d0a3-46cd-92ad-9b16244ab428 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:41.739371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 562/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:23:41 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:44.251704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b11d8-90f8-4272-94bf-0e93c2505bff None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:44.252321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b11d8-90f8-4272-94bf-0e93c2505bff None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:44.252321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b11d8-90f8-4272-94bf-0e93c2505bff None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:44.253837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 549/1111] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:44.261339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:44.261864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:44.262225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:44.291153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:44.293194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:44.412537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 563/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:44.437681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b11d8-90f8-4272-94bf-0e93c2505bff None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:44.480463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:44.554280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b11d8-90f8-4272-94bf-0e93c2505bff None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:44.590975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:44.591902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:44.592233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:44.592561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] PATH_INFO: `/v3/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:44.594254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] RBAC: Authorizing `identity:get_role(role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:44.595724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:44.597362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 550/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:44 2022] GET /identity/v3/roles/bacfbe396cb341d7a82bead66b616b8f => generated 223 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:44.603970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:44.672921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:44.717019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f36ff-e8fc-4d2b-a486-b66e1bad940d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:44.756850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:44.757742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:44.758023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:44.758326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] PATH_INFO: `/v3/users/2404a94d3064443cbcafbe7afedde35d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:44.784494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] RBAC: Authorizing `identity:get_user(user_id=2404a94d3064443cbcafbe7afedde35d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:44.786014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:44.787840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 564/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:44 2022] GET /identity/v3/users/2404a94d3064443cbcafbe7afedde35d => generated 286 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:44.794338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:44.934629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd15ccca-2155-4bf5-b74b-9a44e7bab9f2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:44.937289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:44.974917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:44.975582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:44.975860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:44.976131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:45.049891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:45.051789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:45.169155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 551/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:23:45.177249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:45.295174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de5c0b-732a-45d2-8e41-48c0c0541384 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:45.317120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:45.333264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:45.334185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:45.334468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:45.334740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:45.336016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:45.337469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a1479-b603-40b6-9325-e96a00409fd4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:45.339213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 565/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:45 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:45.345860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:45.349469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:45.455911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f061c91-9405-4f39-a1d0-748ea79283df None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:45.494202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:45.494878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:45.495160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:45.495441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:45.496290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=837244c064cb4118ac687903ed43b751, user.id=2404a94d3064443cbcafbe7afedde35d) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:45.496605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:45.498127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401c7d83-9fae-4d36-aa9d-fcf2ce874d31 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:45.504910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 552/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:45 2022] GET /identity/v3/role_assignments?user.id=2404a94d3064443cbcafbe7afedde35d&scope.project.id=837244c064cb4118ac687903ed43b751&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:47.582290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b230-51b0-4f4d-8009-43fbeb893d25 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:47.583203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b230-51b0-4f4d-8009-43fbeb893d25 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:47.583203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141b230-51b0-4f4d-8009-43fbeb893d25 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:47.584256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 566/1118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:47.590810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:47.591357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:47.591357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:47.609436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:47.610687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:47.680341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:47.690004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 553/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:47.732825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141b230-51b0-4f4d-8009-43fbeb893d25 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:47.846862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141b230-51b0-4f4d-8009-43fbeb893d25 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:47.884936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:47.885811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:47.886082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:47.886388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] PATH_INFO: `/v3/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:47.887938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] RBAC: Authorizing `identity:get_role(role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:47.889323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:47.890743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 567/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:47 2022] GET /identity/v3/roles/bacfbe396cb341d7a82bead66b616b8f => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:47.897583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:48.009952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc46ca8-bec0-4e93-97e6-6d0ea980c11f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:48.048839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:48.049781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:48.050104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:48.050365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] PATH_INFO: `/v3/users/2404a94d3064443cbcafbe7afedde35d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:48.051632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] RBAC: Authorizing `identity:get_user(user_id=2404a94d3064443cbcafbe7afedde35d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:48.053104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:48.054816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 554/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:47 2022] GET /identity/v3/users/2404a94d3064443cbcafbe7afedde35d => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:48.064016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:48.126953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:48.175052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8e4a1-a07c-45f2-beb4-a28e273adc56 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:48.212364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:48.213246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:48.213523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:48.213793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:48.215086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:48.216567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab6323-490d-4b4d-9d3d-c59161f48192 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:48.218386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 568/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:48 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:48.224856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:48.301315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:48.341054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4dc30d-4cbf-4273-95f3-68fa3749a56c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:48.378395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:48.379207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:48.379487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:48.379759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751/users/2404a94d3064443cbcafbe7afedde35d/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:48.382110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] RBAC: Authorizing `identity:create_grant(project_id=837244c064cb4118ac687903ed43b751, user_id=2404a94d3064443cbcafbe7afedde35d, role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:48.383584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d3eb5-d9eb-4179-b8ca-d3f571a7c09c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:48.398316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 555/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:23:48 2022] PUT /identity/v3/projects/837244c064cb4118ac687903ed43b751/users/2404a94d3064443cbcafbe7afedde35d/roles/bacfbe396cb341d7a82bead66b616b8f => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:23:50.472373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9936-80de-4885-827d-5d3b2972776b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:50.473009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9936-80de-4885-827d-5d3b2972776b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:50.473009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316c9936-80de-4885-827d-5d3b2972776b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:50.474355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 569/1124] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:50.480759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:50.481437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:50.481437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:50.500686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:50.501906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:50.579722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 556/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:50.605973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c9936-80de-4885-827d-5d3b2972776b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:50.721438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316c9936-80de-4885-827d-5d3b2972776b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:50.747911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:50.761248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:50.762631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:50.763072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:50.763499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] PATH_INFO: `/v3/roles/bacfbe396cb341d7a82bead66b616b8f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:50.767743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] RBAC: Authorizing `identity:get_role(role_id=bacfbe396cb341d7a82bead66b616b8f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:50.769372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:50.771605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 570/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:50 2022] GET /identity/v3/roles/bacfbe396cb341d7a82bead66b616b8f => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:50.778360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:50.838383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:50.884209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d4c-7362-4566-a0ec-9aaa1db6af33 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:50.921574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:50.922503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:50.922791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:50.923064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] PATH_INFO: `/v3/users/2404a94d3064443cbcafbe7afedde35d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:50.925322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] RBAC: Authorizing `identity:get_user(user_id=2404a94d3064443cbcafbe7afedde35d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:50.926110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:50.927833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 557/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:50 2022] GET /identity/v3/users/2404a94d3064443cbcafbe7afedde35d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:50.938742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:51.051685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9bfc51-4bd3-4f9a-9b0d-d2e7cb05818a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:51.095275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:51.095828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:51.096205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:51.097107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:51.164246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:51.175590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:51.177080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:51.290219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 571/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:23:51.296234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:51.404838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cdfb26-8f3a-4c1b-843f-5f3d01b46b49 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:51.431006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:51.443288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:51.444154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:51.444429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:51.444696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] PATH_INFO: `/v3/projects/837244c064cb4118ac687903ed43b751` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:51.445882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] RBAC: Authorizing `identity:get_project(project_id=837244c064cb4118ac687903ed43b751)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:51.447366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022ecb-3940-4fa5-baa7-05c8aea4f16e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:51.449095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 558/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:23:51 2022] GET /identity/v3/projects/837244c064cb4118ac687903ed43b751 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:51.459569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:51.571241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:51.582158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d34126b-d064-4b8a-909b-e88a5904ad97 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:51.624432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:51.625109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:51.625396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:51.625665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:51.626584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] RBAC: Adding query filter params (role.id=bacfbe396cb341d7a82bead66b616b8f, scope.project.id=837244c064cb4118ac687903ed43b751, user.id=2404a94d3064443cbcafbe7afedde35d) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:51.626897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:51.628616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb48379-62cd-4bc1-b91e-1824ca804f87 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:51.635798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 572/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:23:51 2022] GET /identity/v3/role_assignments?user.id=2404a94d3064443cbcafbe7afedde35d&scope.project.id=837244c064cb4118ac687903ed43b751&role.id=bacfbe396cb341d7a82bead66b616b8f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:53.721609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6b0-4b03-4f2c-b26d-1152005755ea None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:53.722300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6b0-4b03-4f2c-b26d-1152005755ea None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:53.722300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894c6b0-4b03-4f2c-b26d-1152005755ea None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:53.723648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 559/1131] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:23:53.729611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:53.730148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:53.730276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:53.748653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:53.749899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:53.822837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 573/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:53.847801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c6b0-4b03-4f2c-b26d-1152005755ea None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:53.957250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894c6b0-4b03-4f2c-b26d-1152005755ea None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:53.994843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:53.995554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:53.995835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:53.996109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:53.997323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:53.998817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36088e4-25a8-45a9-b936-1451db7ffeba None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:54.000454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 560/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:54.006891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:54.095961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:54.113416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a98c39-f5e6-4e61-8c32-8328703623df None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:54.156984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:54.158164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:54.158761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:54.159267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:54.160656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:54.163466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0a25a-8525-45f1-a611-1f72d24fb556 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:54.201448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 574/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:23:54 2022] POST /identity/v3/projects => generated 311 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:56.406696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c452b68-0795-4566-af17-e083ecd987f2 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:56.407314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c452b68-0795-4566-af17-e083ecd987f2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:56.407314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c452b68-0795-4566-af17-e083ecd987f2 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:56.408722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 561/1135] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:56.414967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:56.415741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:56.415741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:56.435283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:56.436606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:56.522440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 575/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:56.549096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c452b68-0795-4566-af17-e083ecd987f2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:56.623688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:56.672517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c452b68-0795-4566-af17-e083ecd987f2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:56.709551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:56.710436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:56.710765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:56.711080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:56.712341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:56.713836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a910ba-5b78-442b-9d2b-6fcde6174e09 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:56.715547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 562/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:56.721778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:56.790744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:56.828466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1a6e1-9c5f-4918-9d31-848ba69267e2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:56.866668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:56.867373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:56.867647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:56.867904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:56.868644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:56.870131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cd2c8-57f6-40a0-87a3-34a0cbabee9e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:56.892713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 576/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:23:56 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:23:59.017494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9b5c-2b3d-46cb-88f3-9c7df6778bd8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.019084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9b5c-2b3d-46cb-88f3-9c7df6778bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.019084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ea9b5c-2b3d-46cb-88f3-9c7df6778bd8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.019547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 563/1139] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:23:59.025510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.026037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.026037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.043548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:23:59.044768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:23:59.115277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 577/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:23:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:23:59.139810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea9b5c-2b3d-46cb-88f3-9c7df6778bd8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:59.262740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ea9b5c-2b3d-46cb-88f3-9c7df6778bd8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:59.295426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:59.306027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:59.306880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.307158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.307428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.320491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:23:59.328591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:23:59.330805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:23:59.332849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 564/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:23:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:23:59.339869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:59.410168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:59.459323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a39dc-7471-49cc-be9e-bcb4fdb1232d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:59.502352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:59.503382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.503662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.503938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.504691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:23:59.505010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:59.506417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:59.515513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 578/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:23:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:59.521360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:59.638203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388ef8a-fc91-4312-af14-eefdb269d4ca None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:59.678691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:59.679581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.679863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.680137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] PATH_INFO: `/v3/users/f8a3b63a68134914997675d16a39698d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.695425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] RBAC: Authorizing `identity:get_user(user_id=f8a3b63a68134914997675d16a39698d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:59.696911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:23:59.698727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 565/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:23:59 2022] GET /identity/v3/users/f8a3b63a68134914997675d16a39698d => generated 286 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:23:59.704809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:23:59.823223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f8da8-af00-4392-896d-810b1b1cc115 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:23:59.840228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:23:59.860008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:23:59.860676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:23:59.860960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:23:59.861235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:23:59.933853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:23:59.935274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:00.041642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 579/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:23:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:24:00.048094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:00.103736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:00.165593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c5482-7581-4fc9-a721-79163bc1b67d None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:00.202007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:00.202803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:00.203083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:00.203350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] PATH_INFO: `/v3/projects/d3153a357c2f465b81321d45a0a42ef8` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:00.204596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] RBAC: Authorizing `identity:get_project(project_id=d3153a357c2f465b81321d45a0a42ef8)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:00.206232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d223b-20ed-4eaa-a67b-1a7e84d0affa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:00.207996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 566/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:00 2022] GET /identity/v3/projects/d3153a357c2f465b81321d45a0a42ef8 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:00.214541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:00.234276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:00.333833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed1a9-886d-42dc-9f65-f068925fe30e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:00.373948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:00.374641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:00.374921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:00.375197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:00.376034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=d3153a357c2f465b81321d45a0a42ef8, user.id=f8a3b63a68134914997675d16a39698d) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:00.376351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:00.378098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770023b-1d1e-4b5b-9e25-ddd476ecfdb2 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:00.383968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 580/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:24:00 2022] GET /identity/v3/role_assignments?user.id=f8a3b63a68134914997675d16a39698d&scope.project.id=d3153a357c2f465b81321d45a0a42ef8&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:02.446854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e76841-249e-42c8-94f7-1aac6c2aa4f3 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:02.447431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e76841-249e-42c8-94f7-1aac6c2aa4f3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:02.447431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e76841-249e-42c8-94f7-1aac6c2aa4f3 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:02.448932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 567/1147] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:02.455286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:02.455902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:02.456680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:02.477798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:02.479157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:02.562143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 581/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:02.585908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e76841-249e-42c8-94f7-1aac6c2aa4f3 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:02.699502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e76841-249e-42c8-94f7-1aac6c2aa4f3 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:02.715722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:02.739947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:02.740753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:02.741029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:02.741293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:02.755466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:24:02.763578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:02.771492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:24:02.773381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 568/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:24:02.774969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:02.787503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:02.898845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62d95ee-a012-425a-b5d1-e5502a38cfc6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:02.937207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:02.937903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:02.938213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:02.938492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:02.939256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:02.939565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:02.941035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:02.950528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 582/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:02.957414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:03.125382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ae3e54-70a8-4183-afc8-2676413faca5 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:03.165958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:03.166945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:03.167278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:03.167600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] PATH_INFO: `/v3/users/f8a3b63a68134914997675d16a39698d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:03.169011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] RBAC: Authorizing `identity:get_user(user_id=f8a3b63a68134914997675d16a39698d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:03.170628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:03.172400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 569/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:24:02 2022] GET /identity/v3/users/f8a3b63a68134914997675d16a39698d => generated 286 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:03.179420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:03.274820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:03.314692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9e3c5-72ab-4f1e-8661-94ef3a2bdab6 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:03.357811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:03.358830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:03.359164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:03.359486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] PATH_INFO: `/v3/projects/d3153a357c2f465b81321d45a0a42ef8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:03.361055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] RBAC: Authorizing `identity:get_project(project_id=d3153a357c2f465b81321d45a0a42ef8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:03.362718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae7dd43-13f5-40cb-b8e5-2252ac38c238 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:03.364633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 583/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:03 2022] GET /identity/v3/projects/d3153a357c2f465b81321d45a0a42ef8 => generated 311 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:03.371175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:03.420527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:03.485341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb616-75ed-4c4a-ab72-d7980d77af9b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:03.523280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:03.524186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:03.524473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:03.524749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] PATH_INFO: `/v3/projects/d3153a357c2f465b81321d45a0a42ef8/users/f8a3b63a68134914997675d16a39698d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:03.526914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3153a357c2f465b81321d45a0a42ef8, user_id=f8a3b63a68134914997675d16a39698d, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:03.528402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db467a0-217c-4194-a742-314c744394b1 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:03.544622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 570/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:24:03 2022] PUT /identity/v3/projects/d3153a357c2f465b81321d45a0a42ef8/users/f8a3b63a68134914997675d16a39698d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:24:05.709599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b202f9-86f4-4041-b4c6-4e37a8b4b8c1 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:05.710209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b202f9-86f4-4041-b4c6-4e37a8b4b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:05.710209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b202f9-86f4-4041-b4c6-4e37a8b4b8c1 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:05.711540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 584/1154] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:05.721436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:05.722075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:05.722450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:05.743405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:05.744620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:05.816067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 571/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:05.840951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b202f9-86f4-4041-b4c6-4e37a8b4b8c1 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:05.953484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b202f9-86f4-4041-b4c6-4e37a8b4b8c1 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:05.996141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:05.997125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:05.997436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:05.997750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:06.006966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:06.011365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:24:06.019865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:06.021050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:24:06.022127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 585/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:24:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:24:06.028069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:06.060279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:06.155064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ede8b9-f584-4a18-bad8-45db49acc218 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:06.194045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:06.194752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:06.195046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:06.195298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:06.196056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:06.196364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:06.197764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:06.207668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 572/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:24:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:06.213638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:06.335315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d12a2-e974-4326-bfed-d88297de8ea7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:06.380258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:06.381160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:06.381442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:06.381842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] PATH_INFO: `/v3/users/f8a3b63a68134914997675d16a39698d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:06.383973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] RBAC: Authorizing `identity:get_user(user_id=f8a3b63a68134914997675d16a39698d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:06.385662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:06.387905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 586/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:24:06 2022] GET /identity/v3/users/f8a3b63a68134914997675d16a39698d => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:06.394338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:06.501208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:06.509329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c42e32d-bf3b-4966-8634-d0c680724c91 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:06.546712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:06.547373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:06.547654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:06.547920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:06.625424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:06.626920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:06.729946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:06.739013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 573/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:24:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:24:06.744961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:06.831880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:06.871498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd29b76-09f5-470f-8b83-64d0aac5f640 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:06.910346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:06.911221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:06.911507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:06.911779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] PATH_INFO: `/v3/projects/d3153a357c2f465b81321d45a0a42ef8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:06.912984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] RBAC: Authorizing `identity:get_project(project_id=d3153a357c2f465b81321d45a0a42ef8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:06.914463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e010647c-39e5-4c2d-9623-123cb9f23d25 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:06.916187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 587/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:06 2022] GET /identity/v3/projects/d3153a357c2f465b81321d45a0a42ef8 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:24:06.922475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:07.025313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7b87-5cc1-4195-8a48-34284a8833fd None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:07.072259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:07.072934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:07.073215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:07.073493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:07.074387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=d3153a357c2f465b81321d45a0a42ef8, user.id=f8a3b63a68134914997675d16a39698d) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:07.074703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:07.076206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b28a0c-f912-4f0f-9abf-3e9c6de2433a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:07.083695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 574/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:24:06 2022] GET /identity/v3/role_assignments?user.id=f8a3b63a68134914997675d16a39698d&scope.project.id=d3153a357c2f465b81321d45a0a42ef8&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:09.203434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7888-3545-48a4-9643-3b4d95ff68fa None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:09.203994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7888-3545-48a4-9643-3b4d95ff68fa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:09.203994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa7888-3545-48a4-9643-3b4d95ff68fa None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:09.205401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 588/1162] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:09.211362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:09.211987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:09.211987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:09.229853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:09.231112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:09.292370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:09.307310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 575/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:09.330545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa7888-3545-48a4-9643-3b4d95ff68fa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:09.441524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa7888-3545-48a4-9643-3b4d95ff68fa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:09.476927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:09.477504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:09.477786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:09.478099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:09.481773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:09.550865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:09.552364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:09.663675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 589/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:24:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:24:09.673506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:09.804341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7a94e5-6af3-483e-9a35-5801a986957b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:09.845563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:09.846763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:09.847240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:09.847658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:09.856492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:09.858125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-fbc1647b-e434-44f5-a36b-34c16b9c2c1a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:09.874432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:09.876457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:24:09.878241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 576/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:24:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:24:09.882882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:09.928148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:10.008970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13f82ce-a13a-4944-9300-316574426ebc None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:10.064599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:10.065958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:10.066718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:10.067165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:10.068627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:10.069193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:10.071953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204e2e0-bc56-423a-a002-44aad9ff7272 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:10.087077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 590/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jun 21 10:24:09 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:12.297515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17311-7001-484f-af32-4c41c6f34523 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:12.298085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17311-7001-484f-af32-4c41c6f34523 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:12.298085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea17311-7001-484f-af32-4c41c6f34523 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:12.299535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 577/1167] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:12.307352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce1b7-e5b2-472d-9742-6b6aab6108fc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:12.307924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce1b7-e5b2-472d-9742-6b6aab6108fc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:12.308348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38ce1b7-e5b2-472d-9742-6b6aab6108fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:12.335405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b38ce1b7-e5b2-472d-9742-6b6aab6108fc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:12.337415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b38ce1b7-e5b2-472d-9742-6b6aab6108fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:12.463359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 591/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:12.489268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea17311-7001-484f-af32-4c41c6f34523 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:12.573304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:12.637751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea17311-7001-484f-af32-4c41c6f34523 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:12.674670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:12.675429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:12.675715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:12.675987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:12.676756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:12.678195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b586882e-2f2e-4f94-b859-9ad27d48b039 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:12.695120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 578/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Jun 21 10:24:12 2022] POST /identity/v3/domains => generated 267 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:24:14.839740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c1af-be62-40ad-9b72-da371910e929 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:14.840317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c1af-be62-40ad-9b72-da371910e929 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:14.840317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9c1af-be62-40ad-9b72-da371910e929 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:14.841803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 592/1170] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:14.852554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:14.853160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:14.853160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:14.875257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:14.876733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:14.956016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 579/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:14.980721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9c1af-be62-40ad-9b72-da371910e929 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:15.013858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:15.095565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9c1af-be62-40ad-9b72-da371910e929 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:15.132011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:15.132892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:15.133174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:15.133449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] PATH_INFO: `/v3/domains/e8537b6d887b4c829bfe3d980dcdded4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:15.146026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] RBAC: Authorizing `identity:get_domain(domain_id=e8537b6d887b4c829bfe3d980dcdded4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:15.148251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd13cdf1-45c2-435e-93d9-479d8e78aace None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:15.150286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 593/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jun 21 10:24:14 2022] GET /identity/v3/domains/e8537b6d887b4c829bfe3d980dcdded4 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:15.156436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:15.208828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:15.284421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa0ffc-0058-4d07-b5e5-852b0f661fd2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:15.325118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:15.325789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:15.326090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:15.326375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:15.327089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:15.328561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759936f0-9916-440c-9776-ee64e202d191 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:15.357717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 580/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:24:15 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:24:17.478377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd395-5fa2-4819-bd35-ac28602179cc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:17.479055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd395-5fa2-4819-bd35-ac28602179cc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:17.479055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dd395-5fa2-4819-bd35-ac28602179cc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:17.480380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 594/1174] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:24:17.487127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:17.487996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:17.487996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:17.506549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:17.508445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:17.587656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 581/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:17.614097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd395-5fa2-4819-bd35-ac28602179cc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:17.723321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:17.744552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dd395-5fa2-4819-bd35-ac28602179cc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:17.784616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:17.785497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:17.785774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:17.786077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] PATH_INFO: `/v3/domains/e8537b6d887b4c829bfe3d980dcdded4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:17.787346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] RBAC: Authorizing `identity:get_domain(domain_id=e8537b6d887b4c829bfe3d980dcdded4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:17.788808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18382c7-51ea-4c85-875b-f22d46fc534c None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:17.790501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 595/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jun 21 10:24:17 2022] GET /identity/v3/domains/e8537b6d887b4c829bfe3d980dcdded4 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:17.796734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:17.821189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:17.911432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de060e5-8a65-4fd8-b4af-46c1434c7e23 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:17.952426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:17.953105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:17.953388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:17.953663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:17.954425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:17.956155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daceb045-8cb3-4b3e-9a08-aa9b32687a17 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:17.978774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 582/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:24:17 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:24:20.126869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54da4f-c53e-4460-902f-7562ab7650bd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.127677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54da4f-c53e-4460-902f-7562ab7650bd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.127677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54da4f-c53e-4460-902f-7562ab7650bd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:20.129389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 596/1178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:20.135527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.136086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.136086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:20.154655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:20.155960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:20.236101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 583/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:20.276330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54da4f-c53e-4460-902f-7562ab7650bd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:20.397529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54da4f-c53e-4460-902f-7562ab7650bd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:20.438474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:20.439364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.440325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.440609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:20.454030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:24:20.462878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:20.464566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:24:20.465685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 597/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:24:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:24:20.471578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:20.484000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:20.597349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08fe98f-4ae3-4525-8056-257cf043327d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:20.637865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:20.638579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.638861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.639135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:20.639898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:20.640204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:20.641616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:20.651550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 584/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:20.657792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:20.680220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:20.769171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09367513-7ec5-49d6-b2d4-8fcf87688e2b None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:20.807332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:20.808229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.808513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.808784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] PATH_INFO: `/v3/users/7d737307678541bb8d03fc5830e87e84` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:20.824850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] RBAC: Authorizing `identity:get_user(user_id=7d737307678541bb8d03fc5830e87e84)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:20.826369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:20.828158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 598/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:24:20 2022] GET /identity/v3/users/7d737307678541bb8d03fc5830e87e84 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:20.834909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:20.913756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:20.951215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7122d1d-7f76-4a81-b743-23b8d66a14aa None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:20.989775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:20.990482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:20.990766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:20.991044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:21.065027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:21.066564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:21.135658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:21.177780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 585/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:24:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:24:21.183071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:21.277957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:21.303251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35146acd-24bb-473c-98c6-c55a4717abf5 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:21.346760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:21.347766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:21.348092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:21.348408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] PATH_INFO: `/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:21.349707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] RBAC: Authorizing `identity:get_project(project_id=9a2cafe4a26248f1a45f7d85c31806b5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:21.351282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c80fd-99f2-40a2-a0e8-e6abcb9f90eb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:21.353416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 599/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:21 2022] GET /identity/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:21.360151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:21.483458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc81da-7642-4ed2-8d0f-9202ac676783 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:21.527354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:21.527629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:21.527802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:21.529610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:21.529610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=9a2cafe4a26248f1a45f7d85c31806b5, user.id=7d737307678541bb8d03fc5830e87e84) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:21.529610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:21.530643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b7b4-2d45-4672-9ff5-3f21f66e45a7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:21.538140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 586/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:24:21 2022] GET /identity/v3/role_assignments?user.id=7d737307678541bb8d03fc5830e87e84&scope.project.id=9a2cafe4a26248f1a45f7d85c31806b5&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:23.652965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c197-045c-4ef0-bd2d-75a51e47f893 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:23.653608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c197-045c-4ef0-bd2d-75a51e47f893 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:23.653608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15c197-045c-4ef0-bd2d-75a51e47f893 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:23.655178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 600/1186] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:23.661875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:23.662496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:23.662496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:23.682773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:23.684129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:23.714347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:23.761735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 587/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:23.786145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c197-045c-4ef0-bd2d-75a51e47f893 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:23.936318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15c197-045c-4ef0-bd2d-75a51e47f893 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:23.975189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:23.976069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:23.976773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:23.977094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:23.989684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:24:23.997634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:23.998939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:24:24.000562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 601/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:24:24.006894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:24.119310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81e577e-47ee-4839-89d1-b451c39fbb25 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:24.158224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:24.159567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:24.159847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:24.160124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:24.160893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:24.161201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:24.162651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:24.171753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 588/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:24:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:24.177965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:24.182089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:24.299009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5a7d9-3346-4374-8154-9d669a950a76 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:24.354619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:24.355913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:24.356409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:24.356896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] PATH_INFO: `/v3/users/7d737307678541bb8d03fc5830e87e84` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:24.359040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] RBAC: Authorizing `identity:get_user(user_id=7d737307678541bb8d03fc5830e87e84)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:24.362087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:24.365091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 602/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:24:24 2022] GET /identity/v3/users/7d737307678541bb8d03fc5830e87e84 => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:24.371161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:24.400634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:24.482273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e08060f-ddfc-4819-99e3-07008125142f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:24.518740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:24.519589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:24.519867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:24.520140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] PATH_INFO: `/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:24.521470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] RBAC: Authorizing `identity:get_project(project_id=9a2cafe4a26248f1a45f7d85c31806b5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:24.523141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682c4b5-9770-44ee-bce2-7a24c47b9e51 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:24.525756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 589/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:24 2022] GET /identity/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:24.532160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:24.614586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:24.657819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a23e7-1303-4565-8b91-c0bf900b087f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:24.722586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:24.724168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:24.724659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:24.725137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] PATH_INFO: `/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5/users/7d737307678541bb8d03fc5830e87e84/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:24.729190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] RBAC: Authorizing `identity:create_grant(project_id=9a2cafe4a26248f1a45f7d85c31806b5, user_id=7d737307678541bb8d03fc5830e87e84, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:24.732052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba5f37d-2be2-4f88-a4c3-bc0fbbca8839 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:24.751112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 603/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:24:24 2022] PUT /identity/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5/users/7d737307678541bb8d03fc5830e87e84/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:24:26.813101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca444c-7f47-4f48-9125-9e91e0b0259d None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:26.813692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca444c-7f47-4f48-9125-9e91e0b0259d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:26.814085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca444c-7f47-4f48-9125-9e91e0b0259d None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:26.816562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 590/1193] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:24:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:24:26.822668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:26.823223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:26.823223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:26.841988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:24:26.843237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:24:26.925343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 604/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:24:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:24:26.949683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca444c-7f47-4f48-9125-9e91e0b0259d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:27.059251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:27.071839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca444c-7f47-4f48-9125-9e91e0b0259d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:27.110461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:27.111274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:27.111586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:27.111867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:27.124819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:24:27.132506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:24:27.134257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:24:27.136066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 591/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:24:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:24:27.142420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:27.229954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:27.279939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c1e99-5191-4a3e-b6fc-223fc397b136 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:27.320145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:27.320822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:27.321101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:27.321363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:27.322226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:27.322477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:27.323882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:27.333623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 605/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:24:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:27.339962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:27.452055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe43f49-755c-424b-aec9-c5677f050872 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:27.491913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:27.492790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:27.493069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:27.493336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] PATH_INFO: `/v3/users/7d737307678541bb8d03fc5830e87e84` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:27.494614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] RBAC: Authorizing `identity:get_user(user_id=7d737307678541bb8d03fc5830e87e84)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:27.496081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:27.497748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 592/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jun 21 10:24:27 2022] GET /identity/v3/users/7d737307678541bb8d03fc5830e87e84 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:27.504370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:27.667872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b1784-e3b3-4a25-86a4-ed4488af826f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:27.707303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:27.727422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:27.728543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:27.729030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:27.729518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:27.825554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:27.828460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:28.014739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 606/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:24:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:24:28.024397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:28.051467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:28.142698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58a17c-d0f2-4af1-b0b1-e6f876163125 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:28.180352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:28.181276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:28.181598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:28.181922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] PATH_INFO: `/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:28.183318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] RBAC: Authorizing `identity:get_project(project_id=9a2cafe4a26248f1a45f7d85c31806b5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:28.184803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7087e3a-e6b6-4800-9e13-655fa2668fed None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:28.186607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 593/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jun 21 10:24:28 2022] GET /identity/v3/projects/9a2cafe4a26248f1a45f7d85c31806b5 => generated 361 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:28.193330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:24:28.220548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:28.303660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb547cb1-fa71-42ba-a0db-23b57c25fa23 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:24:28.341357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:24:28.342008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:24:28.342298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:24:28.342593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:24:28.343429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=9a2cafe4a26248f1a45f7d85c31806b5, user.id=7d737307678541bb8d03fc5830e87e84) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:24:28.343736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:24:28.345180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707767c0-1d9f-4a4d-b9d1-22d0d0e4b5bb None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:24:28.352307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 607/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:24:28 2022] GET /identity/v3/role_assignments?user.id=7d737307678541bb8d03fc5830e87e84&scope.project.id=9a2cafe4a26248f1a45f7d85c31806b5&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:24:38.176038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=56 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:24:38.348902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=56 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:27.338305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38a62-c9ae-43b9-9f0e-1ad591500e96 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:27.338974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38a62-c9ae-43b9-9f0e-1ad591500e96 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:27.339280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc38a62-c9ae-43b9-9f0e-1ad591500e96 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:27.340866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 594/1201] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:27.348574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:27.349206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:27.349206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:27.369872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:27.371168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:27.466379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 608/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:27.487647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc38a62-c9ae-43b9-9f0e-1ad591500e96 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:27.610239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc38a62-c9ae-43b9-9f0e-1ad591500e96 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:27.651809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:27.653084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:27.653365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:27.653638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:27.666347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:27.668044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:27.687188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:27.688656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:27.690441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:27.690441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:27.690441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:27.690441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:27.690441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 595/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:25:27.695692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:27.832658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846822ba-56a8-463d-bea0-07ea77e77eb3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:27.876780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:27.880830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:27.881535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:27.881821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:27.882250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:27.882992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:27.883517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:27.885334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe38782-c3cf-4762-a28c-8308b7d78a98 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:27.899244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 609/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:27.905937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:27.976334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:28.037262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3e4d8-1bd9-4fd0-89e9-387aba063940 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:28.086340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:28.087040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:28.087323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:28.087608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:28.088330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:28.089941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabbc38-53fa-4cef-a299-b99a19409f93 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:28.126087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 596/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jun 21 10:25:27 2022] POST /identity/v3/users => generated 251 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:25:30.365436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6601fc-f496-45d6-aea6-25f528927495 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:30.366018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6601fc-f496-45d6-aea6-25f528927495 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:30.366018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6601fc-f496-45d6-aea6-25f528927495 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:30.367479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 610/1206] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:30.373927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:30.374442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:30.374826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:30.396688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:30.396688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:30.479281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 597/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:30.504566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6601fc-f496-45d6-aea6-25f528927495 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:30.632226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6601fc-f496-45d6-aea6-25f528927495 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:30.675696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:30.676598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:30.676956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:30.677232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:30.690922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:30.699186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:30.700272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:30.701306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 611/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:25:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:30.707086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:30.752573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:30.820543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a33ffd-2ec1-4b03-9eef-2ceb1d266dda None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:30.863202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:30.864118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:30.864577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:30.864978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:30.865865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:30.866301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:30.867933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:30.878458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 598/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:25:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:30.884103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:30.947963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:31.014527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0a061-1043-48b7-938f-db0309be8d53 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:31.055011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:31.055948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:31.056343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:31.056735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:31.068776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:31.070277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:31.090831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:31.092031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:31.098223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:31.098223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:31.098223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:31.098223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:31.098223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 612/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:31.098523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:31.209308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:31.213091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fac7b3-ba0f-4140-b0d9-d557e1612d2b None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:31.263843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:31.264528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:31.264881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:31.265157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:31.265893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:31.266223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:31.269548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:31.282170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 599/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:31.290767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:31.410153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1254f-799f-4d7f-9e6b-e09216063372 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:31.411852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:31.452632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:31.453592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:31.453976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:31.454493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:31.464031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:31.465411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:31.481328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:31.483097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:31.484149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 613/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:31.489036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:31.623122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2e918-3023-43d1-8c9a-b2fca29059a0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:31.668334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:31.669371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:31.669777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:31.670151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:31.671018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:31.671385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:31.673371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:31.696159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 600/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:31.702528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:31.829406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ac923-3fc4-40ba-ba4b-017070de4464 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:31.880276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:31.881029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:31.881262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:31.881516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:31.924329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:31.976771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:31.978375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:32.137909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 614/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:25:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:25:32.144135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:32.167217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:32.271281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f281aae-2a41-4208-b480-a2a05db2b5df None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:32.329634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:32.330518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:32.330783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:32.331088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:32.345923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:32.347726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:32.370016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:32.371235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:32.372196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:32.372196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:32.372196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:32.372196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:32.372196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 601/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:32.377907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:32.451725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:32.499996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40caf36-64d6-4020-81aa-b4311f160cc1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:32.546542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:32.547313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:32.547624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:32.547976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:32.549333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:32.549333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:32.550638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:32.564887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 615/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:32.571449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:32.684775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:32.721621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a54017-079f-4ac6-b947-aacf7c3a11f0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:32.760852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:32.761782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:32.762031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:32.762322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:32.771366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:32.772982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:32.789123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:32.796329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:32.798603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 602/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:32.799423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:32.923743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2932556-340d-465f-a7e5-a85a6bcf0c0e None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:32.954824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:32.968524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:32.969333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:32.969613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:32.969906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:32.970940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:32.971250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:32.972841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e6c3dd-5295-4df0-8d5b-3a80016f4b37 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:32.988588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 616/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:32.995178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:33.170877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d77fb-8600-4e42-a9c0-d5315e24eefc None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:33.209964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:33.219228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:33.219948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:33.220257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:33.220699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:33.221790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=8b0728c2b6a3473fb4e08f81144c7b14) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:33.222138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:33.223935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881d3739-5c27-4a02-8cfc-dd23b642fa28 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:33.231722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 603/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:25:32 2022] GET /identity/v3/role_assignments?user.id=8b0728c2b6a3473fb4e08f81144c7b14&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:25:35.402645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4f13-f94e-4510-85a9-338e0e20e80c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:35.403738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4f13-f94e-4510-85a9-338e0e20e80c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:35.403738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af4f13-f94e-4510-85a9-338e0e20e80c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:35.404880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 617/1220] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:35.411203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:35.411716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:35.411808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:35.431457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:35.432721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:35.508102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 604/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:35.537010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af4f13-f94e-4510-85a9-338e0e20e80c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:35.669276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af4f13-f94e-4510-85a9-338e0e20e80c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:35.711429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:35.712278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:35.712563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:35.712834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:35.724909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:35.733036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:35.734988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:35.737206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 618/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:35.742493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:35.856804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67198a85-688d-4cfb-84fc-3d63d68f6eca None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:35.887905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:35.905462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:35.906628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:35.907125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:35.907608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:35.909012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] RBAC: Adding query filter params (name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:35.909568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:35.912207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:35.943352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 605/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:35.949496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:36.009870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:36.086083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee317ed-711e-4899-97d8-201b049b3862 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:36.127524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:36.128273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:36.128546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:36.128835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:36.142310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:36.143970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:36.162377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:36.163366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:36.164286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:36.164286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:36.164286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:36.164286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:36.164286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 619/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:36.169719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:36.294823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2ac0a-c65a-41f5-84b5-d7570b16057e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:36.339172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:36.340204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:36.340645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:36.341085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:36.341950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:36.342460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:36.344121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:36.360653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 606/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:36.366779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:36.486224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:36.494393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628f659-c0a4-4611-9c70-5b947a6365af None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:36.532642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:36.533984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:36.534275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:36.534541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:36.542901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:36.544590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:36.561401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:36.563351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:36.565043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 620/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:36.568984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:36.626352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:36.685852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e6be3-bf02-44a1-b77a-a8536b881104 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:36.731132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:36.731997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:36.732377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:36.732697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:36.733602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:36.733916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:36.735482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:36.756961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 607/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:36.763278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:36.880642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5312dd13-6ca5-41b3-a388-c3c8fcb5aa01 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:36.918261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:36.919081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:36.919367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:36.919693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:36.933029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:36.934782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:36.960043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:36.961248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:36.962363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:36.962363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:36.962363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:36.962363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:36.966938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 621/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:36.967987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:37.088049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2955cbe2-b5b4-4635-8140-9d9939233934 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:37.091825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:37.127198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:37.127938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:37.128246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:37.128525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:37.129254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:37.129595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:37.131131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:37.149231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 608/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:25:37.150608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:37.161127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:37.264648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23220d6-f79f-48c3-9dc9-b4dbceeb7614 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:37.305335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:37.306219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:37.306503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:37.306828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:37.316186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:37.317664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:37.332762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:37.333992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:37.334995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 622/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:37.340271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:37.452940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f99b5f-3212-4cc3-978a-d5d4127f3a19 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:37.491486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:37.492155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:37.492428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:37.492700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:37.493486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:37.493797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:37.495286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62773e-f9ba-4326-9388-2e1afb6b6ef0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:37.515234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 609/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:37.516569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:37.598393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:37.632823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153974b-f56a-4757-a14b-49b1b5e65979 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:37.673506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:37.674522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:37.674834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:37.675117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/8b0728c2b6a3473fb4e08f81144c7b14/roles/fccb91fd8481458f89166218b2b562c5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:37.691121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=8b0728c2b6a3473fb4e08f81144c7b14, role_id=fccb91fd8481458f89166218b2b562c5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:37.692634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa62ebc-0ae3-496e-aa5c-eec93c637cd0 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:37.708405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 623/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:25:37 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/8b0728c2b6a3473fb4e08f81144c7b14/roles/fccb91fd8481458f89166218b2b562c5 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:25:39.911792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba9a-2811-423c-85c5-91c2d9afd6c0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:39.912384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba9a-2811-423c-85c5-91c2d9afd6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:39.912384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4ba9a-2811-423c-85c5-91c2d9afd6c0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:39.913962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 610/1233] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:39.919971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:39.920579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:39.920579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:39.940158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:39.941621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:40.026038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 624/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:40.053147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ba9a-2811-423c-85c5-91c2d9afd6c0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:40.086514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:40.180136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4ba9a-2811-423c-85c5-91c2d9afd6c0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:40.217692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:40.218720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:40.219097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:40.219465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:40.232593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:40.242461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:40.243721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:40.244731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 611/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:40.250358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:40.310234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:40.377327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79340b6e-4ab1-4d2c-ade7-cfe43b64d8d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:40.413819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:40.414598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:40.414922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:40.415223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:40.416015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:40.416325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:40.417832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:40.427856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 625/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:25:40.434085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:40.524910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:40.542508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0bdb92-29c2-4fce-bfd7-667c4250cd03 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:40.580112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:40.580995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:40.581301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:40.581590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:40.593726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:40.595333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:40.614802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:40.616004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:40.616986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:40.616986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:40.616986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:40.616986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:40.616986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 612/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:40.622621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:40.736675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d56d940-703f-4a5c-95b3-aef90b561a12 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:40.746997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:40.775469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:40.776218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:40.776485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:40.776799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:40.777553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:40.777864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:40.779294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:40.792160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 626/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:40.798234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:40.914825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993a103-3f2d-4c9a-8b15-34337595dd82 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:40.954907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:40.955799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:40.956040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:40.956326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:40.960046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:40.966898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:40.969164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:40.985125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:40.987453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:40.989329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 613/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:40.993268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:41.118404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d2834-558a-4415-b397-ce88dbdc6c5d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:41.162832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:41.163581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:41.163912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:41.164222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:41.165144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:41.165478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:41.167153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:41.186943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 627/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:41.193697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:41.314934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6aa8ed-6d20-4ceb-9a87-66c2e0b157f2 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:41.351736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:41.352416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:41.352839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:41.353068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:41.425056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:41.433198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:41.434734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:41.552230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 614/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:25:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 21 10:25:41.558720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:41.591404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:41.678906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4552b-bbe1-4d29-95d7-2a23796b5db7 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:41.724441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:41.725239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:41.725511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:41.726174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:41.741371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:41.743872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:41.766326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:41.769284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:41.770808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:41.770808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:41.770808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:41.770808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:41.770808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 628/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:41.774884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:41.893408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:41.900234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb54bd-bd8f-47b2-9958-e7618ae3b819 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:41.942391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:41.943101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:41.943392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:41.943669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:41.944513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:41.944825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:41.946345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:41.960055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 615/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:41.966178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:42.054073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:42.079205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bfe7a3-9736-4b4d-bfbc-98728b8af573 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:42.119555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:42.120372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:42.120684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:42.120955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:42.128940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:42.130451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:42.145369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:42.146653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:42.147656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 629/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:42.153114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:42.266271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27232f7-86b3-4a81-bdce-7441f99c3d25 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:42.306741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:42.307414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:42.307695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:42.307974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:42.308768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:42.309081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:42.310694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd27ec-50f2-44f5-a52b-09cc03582624 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:42.334921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 616/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:42.341059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:42.460795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9f26d-1320-47ba-8acf-c5c975658ab1 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:42.510757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:42.511449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:42.511768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:42.512054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:42.512986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] RBAC: Adding query filter params (role.id=fccb91fd8481458f89166218b2b562c5, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=8b0728c2b6a3473fb4e08f81144c7b14) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:42.513293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:42.514914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a29861-f389-4d44-8864-1cbe3da80163 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:42.526208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 630/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:25:42 2022] GET /identity/v3/role_assignments?user.id=8b0728c2b6a3473fb4e08f81144c7b14&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=fccb91fd8481458f89166218b2b562c5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:44.900039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c7e4-fb47-4523-abbd-b4de9da4d51c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:44.900650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c7e4-fb47-4523-abbd-b4de9da4d51c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:44.900650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6c7e4-fb47-4523-abbd-b4de9da4d51c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:44.902169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 617/1247] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:25:44.908044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:44.908616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:44.908616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:44.914349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:44.928886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:44.930509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:45.009452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 631/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:45.035807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c7e4-fb47-4523-abbd-b4de9da4d51c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:45.057298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:45.157978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6c7e4-fb47-4523-abbd-b4de9da4d51c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:45.200539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:45.201346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:45.201626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:45.201897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:45.218110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:45.227533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:45.228663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:45.229579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 618/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:25:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:45.236138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:45.358046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da15605a-c3e1-40a4-9b58-47a362c7d9ca None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:45.391978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:45.398646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40057-1573-445b-8387-56103c349761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:45.399491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40057-1573-445b-8387-56103c349761 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:45.399772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40057-1573-445b-8387-56103c349761 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:45.400042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc40057-1573-445b-8387-56103c349761 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:45.401106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40057-1573-445b-8387-56103c349761 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:45.401106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40057-1573-445b-8387-56103c349761 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:45.402500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc40057-1573-445b-8387-56103c349761 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:45.412652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 632/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:25:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:45.418941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:45.511335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:45.541010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1932f76-5d39-4a72-9b5f-69132a5fab40 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:45.587340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:45.588256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:45.588570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:45.588912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:45.602913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:45.604618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:45.626221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:45.628061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:45.629323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:45.629323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:45.629323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:45.629323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:45.633156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 619/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:45.634513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40057-1573-445b-8387-56103c349761 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:45.763028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc40057-1573-445b-8387-56103c349761 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:45.803913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:45.804708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:45.805006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:45.805299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:45.806318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:45.806642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:45.808393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:45.822941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 633/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:45.829619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:45.954655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36473c-a883-4324-8527-c4dec2ff7de7 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:45.992066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:46.003375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:46.004217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:46.004517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:46.004816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:46.014123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:46.015879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:46.035193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:46.036274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:46.037234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 620/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:46.042614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:46.109940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:46.165086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b889a-1889-4ba1-840a-67c71bff98ef None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:46.203227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:46.204525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:46.204908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:46.205330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:46.206337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:46.206709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:46.208485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:46.228711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 634/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:46.235875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:46.367842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbbf73-f441-44a1-addc-3a1db6a9c09c None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:46.408287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:46.408987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:46.409314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:46.409634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:46.476951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:46.493002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:46.494512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:46.601687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 621/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:25:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:25:46.607654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:46.724079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72398aa9-93fc-4a25-a084-54f65a746fad None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:46.739514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:46.763230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:46.764141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:46.764444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:46.764754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:46.778026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:46.779722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:46.799497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:46.800950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:46.802662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:46.802662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:46.802662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:46.802662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:46.802662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 635/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:46.806807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:46.914891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:46.929737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1519a-08da-45b1-bf05-76d8d60342f8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:46.972104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:46.972879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:46.973109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:46.973319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:46.974041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:46.974427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:46.976113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:46.988215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 622/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:46.993972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:47.102969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3f369-9d42-4c02-add6-ec3498638e4f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:47.152951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:47.154387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:47.154822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:47.155258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:47.167010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:47.171147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:47.186468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:47.187701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:47.189212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 636/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:47.194535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:47.307860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03f25-d4d1-425b-99cc-931b3d179fe4 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:47.343940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:47.344615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:47.344960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:47.345294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:47.346371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:47.346755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:47.348401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc1c1d1-45e8-4a0e-b3cd-4446cca3f0ba None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:47.367895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 623/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:47.369206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:47.397847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:47.485845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc0c199-d840-47a6-b21b-4a0e7b5f948a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:47.520305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:47.520961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:47.521241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:47.521513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:47.522369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=8b0728c2b6a3473fb4e08f81144c7b14) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:47.522679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:47.524116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3bdc9-5561-47c3-b41c-2cb943446ee1 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:47.529855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 637/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:25:47 2022] GET /identity/v3/role_assignments?user.id=8b0728c2b6a3473fb4e08f81144c7b14&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:49.611032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8210e-8220-45b5-a260-5ca00f303b4a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:49.611622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8210e-8220-45b5-a260-5ca00f303b4a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:49.611790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8210e-8220-45b5-a260-5ca00f303b4a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:49.613552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 624/1261] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:49.619130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:49.619535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:49.619679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:49.637395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:49.638630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:49.709195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 638/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:49.732494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8210e-8220-45b5-a260-5ca00f303b4a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:49.744000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:49.840764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8210e-8220-45b5-a260-5ca00f303b4a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:49.877072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:49.877780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:49.878111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:49.878368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:49.889082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:49.896872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:49.897875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:49.898804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 625/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:49.904610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:49.926889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:50.025675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e53a03e-b4ad-453e-b026-ab96c1b0b296 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.061677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.062374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.062659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.062936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.063721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:50.064037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.065513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.073948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 639/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:50.080417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:50.153009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:50.189741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4b1a4-d4ae-49a1-88af-d3acf9e20375 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.224955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.226098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.226409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.226688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.238812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.240290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:50.258663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:50.259623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:50.260518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:50.260518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:50.260518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:50.260518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:50.260518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 626/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:50.266107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:50.350022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:50.371613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef236056-afd7-4201-a709-3a8d51956c43 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.406656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.407302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.408119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.408397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.409126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:50.409432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.410816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.422878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 640/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:50.429741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:50.540413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf909f0b-a275-489b-bfeb-584146ac2944 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.561085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:50.575979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.576797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.577080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.577496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.586304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.587763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:50.603053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:50.604235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:50.605202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 627/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:25:50.611048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:50.721630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6790dd-9a51-4cfa-9dbc-de86206c0b69 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.758602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.759282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.759560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.759830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.760666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:50.760976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.762455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.771813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:50.780685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 641/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:50.786895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:50.897119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889678be-4191-4ae5-b870-121ed747fad0 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:50.946832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:50.947751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:50.948055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:50.948378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:50.963118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:50.965011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:50.989164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:50.990316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:50.991464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:50.991464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:50.991464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:50.991464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:50.991464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 628/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:50.997544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:51.114812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1755eb42-aa8c-461f-be45-872374db62cd None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:51.151687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:51.152351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:51.152630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:51.152903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:51.153626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:51.153930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:51.155334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:51.167371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 642/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:51.173359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:51.205942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:51.278682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b93a7-e2c7-4960-b92c-7262748696e6 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:51.320827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:51.321634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:51.321890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:51.322245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:51.332549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:51.334920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:51.357726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:51.359134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:51.360633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 629/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:25:51.366968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:51.432588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:51.478100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec001d0-af9c-47ce-8b36-080d292b3e7a None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:51.512975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:51.513628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:51.513906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:51.514199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:51.514994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:51.515294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:51.516900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1240e-b994-4e25-85c6-0c37617988cf None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:51.529393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 643/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:51.535689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:51.630590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:51.639725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11a2e93-8c97-455b-8924-e5e4977b0dce None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:51.678525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:51.679432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:51.679720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:51.679988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] PATH_INFO: `/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/8b0728c2b6a3473fb4e08f81144c7b14/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:51.682140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a922fd1809c4a278bff6b545c0397c2, user_id=8b0728c2b6a3473fb4e08f81144c7b14, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:51.683625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1be161-a8c2-4ab0-ba00-b704f1c08f58 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:51.698828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 630/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jun 21 10:25:51 2022] PUT /identity/v3/projects/2a922fd1809c4a278bff6b545c0397c2/users/8b0728c2b6a3473fb4e08f81144c7b14/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:25:53.716260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f903-3da5-4f94-b640-f177c1aff51e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:53.716874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f903-3da5-4f94-b640-f177c1aff51e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:53.716874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a8f903-3da5-4f94-b640-f177c1aff51e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:53.718207 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 644/1274] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:53.723854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:53.724400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:53.724400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:53.742900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:53.744098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:53.821463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 631/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:53.845491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f903-3da5-4f94-b640-f177c1aff51e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:53.956983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a8f903-3da5-4f94-b640-f177c1aff51e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:53.979345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:54.000457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.001575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.002040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.002449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.012970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 21 10:25:54.020824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:54.021869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:54.022776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 645/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jun 21 10:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:54.028320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:54.129583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:54.158786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2fbeff-e787-461c-a908-a48eaf7fafae None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:54.194660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.195334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.195618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.195918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.196624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:54.196929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:54.198354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:54.207486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 632/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:54.213473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:54.342206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac8092-af6b-4b1c-b7b6-f541d248dd5f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:54.382244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.383051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.383328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.383597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.396555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:54.398074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:54.417432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:54.418706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:54.419750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:54.419750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:54.419750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:54.419750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:54.419750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 646/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:54.425151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:54.539904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed4924-bc1b-4a75-8620-b55a9a8d733f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:54.576444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.577110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.577389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.577663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.578423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:54.578729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:54.580371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:54.591891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 633/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:54.598011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:54.632263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:54.708992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3991a5af-0f65-4aeb-8cb5-558913b28ed4 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:54.746716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.747519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.747801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.748075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.756700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:54.758188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 21 10:25:54.772899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:54.774004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:54.775165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 647/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:54.780201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:54.784650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:54.884336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7e673-34f0-47ce-8a80-aeaaaa4cb177 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:54.919688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:54.920355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:54.920662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:54.920916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:54.921778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:54.922152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:54.923608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:54.942498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 634/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:54.948528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:55.043462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:55.053078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2492940b-fdc1-48bf-b777-759256b8c6e8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:55.086935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:55.087585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:55.087865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:55.088136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:55.157458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:55.158779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:55.248771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:55.260367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 648/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jun 21 10:25:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 21 10:25:55.266460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:55.328336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:55.368903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4892377-31f7-4d7e-9c46-2ac31a0da9a8 None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:55.407371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:55.408266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:55.408446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:55.408747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:55.419721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:55.421195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 21 10:25:55.440464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:55.441568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:55.442543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 21 10:25:55.442543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 21 10:25:55.442543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 21 10:25:55.442543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:55.442543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 635/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 21 10:25:55.447820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:55.553071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d79e47e-1f05-4444-b756-75bb056aee10 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:55.588390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:55.589039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:55.589318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:55.589590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:55.590338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:55.590647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:55.592015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:55.603854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 649/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jun 21 10:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:55.609820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:55.712993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789cb7b-c846-4db4-ac2c-1dfdeca4b42e None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:55.727656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:55.753362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:55.754187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:55.754483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:55.754741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:55.761989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:55.763516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 21 10:25:55.778529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:55.779648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: ERROR keystone.server.flask.application Jun 21 10:25:55.781094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 636/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jun 21 10:25:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:55.788649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:55.841395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:55.894537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d935a01-0bb5-47bc-847f-73fc6ab4c0af None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:55.930884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:55.931636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:55.931954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:55.932250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:55.933157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:55.933600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:55.935180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d39c290-1d4c-4992-b089-84f66372b02d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:55.948989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 650/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jun 21 10:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:55.955432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:56.059297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412c0e7-bc3c-47da-86ef-dc591a6bb1cf None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:56.096942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:56.097725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:56.098083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:56.098357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:56.099203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] RBAC: Adding query filter params (role.id=f65af4fdd36b49d9a28f5e1daeaf26f7, scope.project.id=2a922fd1809c4a278bff6b545c0397c2, user.id=8b0728c2b6a3473fb4e08f81144c7b14) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:56.099515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:56.101336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f894e-48d1-4fe9-b306-b0bbcc8fa51b None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:56.107817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 637/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jun 21 10:25:55 2022] GET /identity/v3/role_assignments?user.id=8b0728c2b6a3473fb4e08f81144c7b14&scope.project.id=2a922fd1809c4a278bff6b545c0397c2&role.id=f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:58.161413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107aa5-ca4c-4a1b-b656-26b26cc6d6fb None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:58.161973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107aa5-ca4c-4a1b-b656-26b26cc6d6fb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:58.161973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e107aa5-ca4c-4a1b-b656-26b26cc6d6fb None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:58.163407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 651/1288] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:25:58.168647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:58.169090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:58.169183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:58.187699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:25:58.188904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:25:58.221872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:58.264397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 638/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:25:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:25:58.287987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107aa5-ca4c-4a1b-b656-26b26cc6d6fb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:58.399742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e107aa5-ca4c-4a1b-b656-26b26cc6d6fb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:58.411352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:25:58.438537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:58.439238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:58.439536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:58.439807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:58.440463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:58.441861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:25:58.454438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:25:58.455635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:25:58.456543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 652/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:25:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:25:58.462108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:58.563663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bb980-e8a8-4c6b-a829-3cb26681ae5d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:58.598360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:58.599017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:58.599303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:58.599581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:58.600298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:58.600963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:58.602379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c743b089-a274-49a0-b248-a0ea259189c8 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:58.607197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 639/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jun 21 10:25:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:25:58.613311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:25:58.713601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d6e99-98eb-4c32-80cb-620dedbd74a8 None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:25:58.749043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:25:58.749708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:25:58.749987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:25:58.750295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] PATH_INFO: `/v3/services` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:25:58.751147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:25:58.751643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:25:58.752944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31762420-8013-483f-bc4a-c9a06d103160 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:25:58.757713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 653/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jun 21 10:25:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:26:00.778570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c905c2-9aef-4045-be42-3cf7ae08a931 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:00.779144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c905c2-9aef-4045-be42-3cf7ae08a931 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:00.779144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c905c2-9aef-4045-be42-3cf7ae08a931 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:00.780500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 640/1293] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:26:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:26:00.786435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae81-cf2b-4f2c-9dd0-a87f348cdbaf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:00.786941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae81-cf2b-4f2c-9dd0-a87f348cdbaf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:00.786941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4aae81-cf2b-4f2c-9dd0-a87f348cdbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:00.807212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e4aae81-cf2b-4f2c-9dd0-a87f348cdbaf None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:26:00.808420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e4aae81-cf2b-4f2c-9dd0-a87f348cdbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:26:00.842448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:00.887858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 654/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:26:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:26:00.914382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c905c2-9aef-4045-be42-3cf7ae08a931 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:00.955124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:01.044778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c905c2-9aef-4045-be42-3cf7ae08a931 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:01.087183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:01.087837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:01.088114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:01.088386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:01.089129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:01.090549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbdc7b2-27a5-49bc-83ab-0d6247b4edcd None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:01.105549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 641/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jun 21 10:26:00 2022] POST /identity/v3/services => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:26:03.188523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342bb0-df9e-4ce8-8a14-4c7b58eedc80 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:03.189092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342bb0-df9e-4ce8-8a14-4c7b58eedc80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:03.189092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec342bb0-df9e-4ce8-8a14-4c7b58eedc80 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:03.190547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 655/1296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:26:03.198715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:03.199193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:03.199285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:03.219897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:26:03.221198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:26:03.303877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 642/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:26:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:26:03.327625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342bb0-df9e-4ce8-8a14-4c7b58eedc80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:03.440605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec342bb0-df9e-4ce8-8a14-4c7b58eedc80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:03.481958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:03.482808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:03.483086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:03.483357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:03.484220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:03.485899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:26:03.500089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:26:03.501915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:03.502847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 656/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:26:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:26:03.510168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:03.533445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:03.642698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09469d4-7c29-4357-a914-1a4a9b82a1ae None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:03.678757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:03.679437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:03.679718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:03.679997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:03.680724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:26:03.681070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:03.682531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:03.688412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 643/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jun 21 10:26:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:26:03.695218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:03.743655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:03.820112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb8eb05-cf5d-49c0-a083-bbb6dfed0d4d None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:03.865251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:03.865915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:03.866224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:03.866630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:03.867464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] RBAC: Adding query filter params (interface=public, service_id=6f809839b7c8410cabbb558fedb3c61e, region_id=RegionOne) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:26:03.867898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:03.869443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9ebb7-098d-4735-9d29-0042032b25c8 None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:03.875375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 657/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jun 21 10:26:03 2022] GET /identity/v3/endpoints?service_id=6f809839b7c8410cabbb558fedb3c61e&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:26:03.881710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:03.998745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:04.024219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77f5c0-9b83-47e9-a6e4-198b4e415e8f None admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:04.065219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:04.065897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:04.066218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:04.066498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:04.067196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:04.068639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0415b054-5f3b-42a4-9942-544288c876f2 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:04.076748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 644/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jun 21 10:26:03 2022] GET /identity/v3/services => generated 2191 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:26:06.173730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df363a1-d80f-4e3a-ac23-b4ff070713be None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:06.174370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df363a1-d80f-4e3a-ac23-b4ff070713be None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:06.174370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df363a1-d80f-4e3a-ac23-b4ff070713be None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:06.175764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 658/1302] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:26:06.181553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707702ba-0748-4861-b2df-470f774cea8a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:06.182080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707702ba-0748-4861-b2df-470f774cea8a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:06.182175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707702ba-0748-4861-b2df-470f774cea8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:06.201555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-707702ba-0748-4861-b2df-470f774cea8a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:26:06.202824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-707702ba-0748-4861-b2df-470f774cea8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:26:06.283622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 645/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:26:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 21 10:26:06.307945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df363a1-d80f-4e3a-ac23-b4ff070713be None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:06.423163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:06.431934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df363a1-d80f-4e3a-ac23-b4ff070713be None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:06.471472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:06.472391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:06.472778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:06.473149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:06.473921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:06.475885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 21 10:26:06.489503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 21 10:26:06.490766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.get_or_create( Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application with Lock( Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self._enter() Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application return self.creator() Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application created_value = creator( Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: ERROR keystone.server.flask.application Jun 21 10:26:06.491798 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 659/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jun 21 10:26:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 21 10:26:06.497509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707702ba-0748-4861-b2df-470f774cea8a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:06.587902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:06.614629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707702ba-0748-4861-b2df-470f774cea8a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:06.651458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:06.652577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:06.652919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:06.653204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] PATH_INFO: `/v3/services` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:06.653922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:26:06.654273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:06.655946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74346964-56c1-495f-9765-b03d2d4d8146 None admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:06.663518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 646/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jun 21 10:26:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:26:06.669666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:26:06.792882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9efbc65-267b-4ff7-9339-e7fa7868a26f None admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:26:06.828592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:26:06.829275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:26:06.829554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:26:06.829834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:26:06.830614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:26:06.831996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90934087-8331-4897-8c79-8bfebe0a99bd None admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:26:06.852663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 660/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jun 21 10:26:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:26:16.658545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=30 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:26:16.847374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:13.416815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec32f0-562b-411c-aaac-7753e08ec5d0 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:13.417408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec32f0-562b-411c-aaac-7753e08ec5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:13.417408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bec32f0-562b-411c-aaac-7753e08ec5d0 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:13.423084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 647/1307] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:13.424616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeddb0-f1a6-4df8-a5e7-57a6329e9842 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:13.425074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeddb0-f1a6-4df8-a5e7-57a6329e9842 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:13.425177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caeddb0-f1a6-4df8-a5e7-57a6329e9842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:13.566685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3caeddb0-f1a6-4df8-a5e7-57a6329e9842 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:13.575792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3caeddb0-f1a6-4df8-a5e7-57a6329e9842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:13.840490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 661/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:13.895748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e14-679e-4069-beec-b08f93c69753 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:13.896116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e14-679e-4069-beec-b08f93c69753 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:13.896758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89143e14-679e-4069-beec-b08f93c69753 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:13.899090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 648/1309] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jun 21 10:27:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:13.909168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade8fb1-d8ee-4129-9403-561bbb58316f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:13.909624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade8fb1-d8ee-4129-9403-561bbb58316f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:13.910246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ade8fb1-d8ee-4129-9403-561bbb58316f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:14.021648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4ade8fb1-d8ee-4129-9403-561bbb58316f None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:14.022934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4ade8fb1-d8ee-4129-9403-561bbb58316f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:14.050319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:14.124833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 662/1310] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jun 21 10:27:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:14.135475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143e14-679e-4069-beec-b08f93c69753 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:14.137928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-89143e14-679e-4069-beec-b08f93c69753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:14.284201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89143e14-679e-4069-beec-b08f93c69753 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:14.405845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:14.406809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:14.407097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:14.407374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:14.409111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:14.471886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:14.564645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:14.567770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cbba2a-f7bb-4c5f-90d7-265bd2ea59d0 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:14.597054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 649/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:17.302192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:17.302870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:17.302870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:17.304177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 663/1312] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:17.310185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cb3-c054-4a07-b432-a38d54a07203 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:17.311052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cb3-c054-4a07-b432-a38d54a07203 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:17.311052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13802cb3-c054-4a07-b432-a38d54a07203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:17.399669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-13802cb3-c054-4a07-b432-a38d54a07203 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:17.401051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-13802cb3-c054-4a07-b432-a38d54a07203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:17.523486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 650/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:17.575301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:17.577740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:17.717571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b726b1-0ac6-48f8-8584-b21f3f3ce894 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:17.822502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:17.826023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:17.827160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:17.827536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:17.828127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:17.830787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:17.959392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:17.960889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618e120-8cbc-4120-b1fb-f334adb14aaf service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:17.981544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 664/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:20.559130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4981af-0631-4aeb-9287-6cc11996e8dc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:20.559716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4981af-0631-4aeb-9287-6cc11996e8dc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:20.559716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4981af-0631-4aeb-9287-6cc11996e8dc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:20.561106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 651/1315] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:20.570158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d11-1747-4c17-9e4b-d7bbf15bbd28 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:20.570975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d11-1747-4c17-9e4b-d7bbf15bbd28 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:20.570975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc477d11-1747-4c17-9e4b-d7bbf15bbd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:20.653924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fc477d11-1747-4c17-9e4b-d7bbf15bbd28 None None] MFA Rules not processed for user `62b75aba48374a829d632b243d81c776`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:20.655307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fc477d11-1747-4c17-9e4b-d7bbf15bbd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:20.731759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:20.786039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 665/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:20.842243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:20.842544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:20.842788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:20.844404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 652/1317] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jun 21 10:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:20.851603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744711-a4b7-4bb2-b0e7-6ca9b38ba17d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:20.851893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744711-a4b7-4bb2-b0e7-6ca9b38ba17d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:20.852174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2744711-a4b7-4bb2-b0e7-6ca9b38ba17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:20.948030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2744711-a4b7-4bb2-b0e7-6ca9b38ba17d None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:20.949267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2744711-a4b7-4bb2-b0e7-6ca9b38ba17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:21.045597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 666/1318] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jun 21 10:27:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:21.054970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:21.056517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:21.066546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:21.170771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf0fb3-40a5-40a3-b0c3-73caa2703cee None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:21.254973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:21.255636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:21.255916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:21.256192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:21.257929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:21.334445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:21.385564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:21.387133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bd4df-0d64-45ca-94e1-ba54c203ac33 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:21.407048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 653/1319] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:24.501600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:24.502200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:24.502200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:24.504337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 667/1320] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:24.512428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac9e4-2747-4385-ab73-76e022352bf6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:24.513526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac9e4-2747-4385-ab73-76e022352bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:24.513526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ac9e4-2747-4385-ab73-76e022352bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:24.589913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a31ac9e4-2747-4385-ab73-76e022352bf6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:24.591185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a31ac9e4-2747-4385-ab73-76e022352bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:24.694745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 654/1321] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:24.734998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:24.736629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:24.790964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:24.850420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373fcf3-c150-4838-99fe-7605f80045f3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:24.927054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:24.927792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:24.928139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:24.928407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:24.930633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:25.058992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:25.075838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:25.077328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fcff1-a201-454f-a49b-1008ee3fa015 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:25.100769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 668/1322] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:27.965034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:27.965669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:27.965669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:27.966978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 655/1323] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:27.973345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeb99b-fcc3-4de0-89d2-02845c4114da None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:27.973860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeb99b-fcc3-4de0-89d2-02845c4114da None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:27.973860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eeb99b-fcc3-4de0-89d2-02845c4114da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:28.045426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c3eeb99b-fcc3-4de0-89d2-02845c4114da None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:28.046674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3eeb99b-fcc3-4de0-89d2-02845c4114da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:28.167530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 669/1324] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:28.205833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:28.207678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:28.230611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:28.341891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1c5d1-6f8f-434b-8f1f-23a44b1aadee None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:28.422861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:28.423513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:28.423792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:28.424057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:28.425723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:28.506144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:28.555381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:28.558195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32f946-1139-449b-962c-99e1f6902c43 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:28.579822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 656/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:30.695345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:30.695934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:30.695934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:30.697168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 670/1326] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:30.702828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7be5d-f734-43f5-b2dd-fd81c432593f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:30.703351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7be5d-f734-43f5-b2dd-fd81c432593f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:30.703461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7be5d-f734-43f5-b2dd-fd81c432593f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:30.773934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9ae7be5d-f734-43f5-b2dd-fd81c432593f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:30.775210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9ae7be5d-f734-43f5-b2dd-fd81c432593f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:30.876330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 657/1327] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:30.912025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:30.913564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:30.978303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:31.023952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb179ac-2b5a-4261-a884-92eee41b260a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:31.108865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:31.109660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:31.109942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:31.110331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:31.112028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:31.236926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:31.239676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:31.241329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0201f462-c5a6-49c6-bf83-836d64f84cec service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:31.262448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 671/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:33.359627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003520-0412-4fa5-b529-21943b8550be None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:33.360193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003520-0412-4fa5-b529-21943b8550be None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:33.360193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61003520-0412-4fa5-b529-21943b8550be None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:33.361639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 658/1329] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:33.367962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee3cd-498a-4bb0-8d0f-e57c4e6d9e64 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:33.368522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee3cd-498a-4bb0-8d0f-e57c4e6d9e64 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:33.368522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ee3cd-498a-4bb0-8d0f-e57c4e6d9e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:33.439476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3b6ee3cd-498a-4bb0-8d0f-e57c4e6d9e64 None None] MFA Rules not processed for user `62b75aba48374a829d632b243d81c776`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:33.440710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3b6ee3cd-498a-4bb0-8d0f-e57c4e6d9e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:33.547966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 672/1330] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:33.585378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003520-0412-4fa5-b529-21943b8550be None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:33.587055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-61003520-0412-4fa5-b529-21943b8550be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:33.619548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:33.697105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61003520-0412-4fa5-b529-21943b8550be None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:33.773988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:33.774667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:33.774945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:33.775214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:33.776862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:33.875179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:33.913067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:33.914601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b07e77-3e8b-4a4c-a715-473f65d07d9b service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:33.935466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 659/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:36.249168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:36.249749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:36.249749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:36.251620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 673/1332] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:36.257754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4a1f-ab99-49e4-8094-6b42162ca2be None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:36.258319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4a1f-ab99-49e4-8094-6b42162ca2be None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:36.258319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6d4a1f-ab99-49e4-8094-6b42162ca2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:36.337224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bb6d4a1f-ab99-49e4-8094-6b42162ca2be None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:36.338520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bb6d4a1f-ab99-49e4-8094-6b42162ca2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:36.440940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 660/1333] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:36.478003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:36.479621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:36.556074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:36.593024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365ab82-1125-4e7a-94be-4fc99c4d5d57 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:36.671529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:36.672224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:36.672497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:36.672866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:36.674524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:36.794542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:36.795996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659072-f102-47f3-88eb-eed1085fe1b5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:36.806482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:36.815843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 674/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:38.945882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:38.946588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:38.946588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:38.947845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 661/1335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:38.953425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dcbb7-e1a1-4b33-b61a-3f992f3abb4d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:38.953917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dcbb7-e1a1-4b33-b61a-3f992f3abb4d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:38.954019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921dcbb7-e1a1-4b33-b61a-3f992f3abb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:39.022874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-921dcbb7-e1a1-4b33-b61a-3f992f3abb4d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:39.024098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-921dcbb7-e1a1-4b33-b61a-3f992f3abb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:39.124270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 675/1336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:39.164693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:39.166272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:39.213755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:39.290290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b527b6-8dc5-4d23-972e-dc5bd21c3741 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:39.366274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:39.366955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:39.367261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:39.367534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:39.369221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:39.459062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:39.487210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:39.488600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed35b8-491c-4c06-b617-6e467681de3d service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:39.506987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 662/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:42.089791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:42.090457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:42.090564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:42.092066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 676/1338] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:42.098263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1251b6-abd7-47af-955b-81467fa194ea None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:42.098815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1251b6-abd7-47af-955b-81467fa194ea None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:42.098815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1251b6-abd7-47af-955b-81467fa194ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:42.167413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fc1251b6-abd7-47af-955b-81467fa194ea None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:42.168687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fc1251b6-abd7-47af-955b-81467fa194ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:42.283003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 663/1339] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:27:42.321809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:42.323551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:42.411482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:42.442670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd637a4-fcfc-481e-bda3-84c6157de64c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:42.524596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:42.525257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:42.525544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:42.525812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:42.527556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:42.660217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:42.661744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777dbcd-cd9a-4bfe-b067-a516d518c4eb service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:42.682714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 677/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:47.179632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:47.180476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:47.180476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:47.182590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 664/1341] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:47.188560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600546-136a-4e62-aac3-40b0e9790ee3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:47.189269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600546-136a-4e62-aac3-40b0e9790ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:47.189269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5600546-136a-4e62-aac3-40b0e9790ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:47.196523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:47.319595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d5600546-136a-4e62-aac3-40b0e9790ee3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:47.321768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5600546-136a-4e62-aac3-40b0e9790ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:47.487585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 678/1342] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:27:47.529927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:47.532692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:47.595450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:27:47.657327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d9366-94a2-4f63-aa49-74cc97976dbc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:47.661564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:47.662320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:47.662601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:47.662915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:47.673906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:47.675515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd500ab4-fa57-4b7d-b0ad-7231b3695235 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:47.687337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 665/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:27:50.794126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e983-9f8e-47bc-8326-76b88cba357c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:50.795013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e983-9f8e-47bc-8326-76b88cba357c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:50.795013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d79e983-9f8e-47bc-8326-76b88cba357c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:50.796104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 679/1344] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:50.802177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639099-85c4-4c55-8492-ce7aabf9bab3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:50.802703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639099-85c4-4c55-8492-ce7aabf9bab3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:50.802802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a639099-85c4-4c55-8492-ce7aabf9bab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:50.840177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4a639099-85c4-4c55-8492-ce7aabf9bab3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:50.841441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4a639099-85c4-4c55-8492-ce7aabf9bab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:50.962398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 666/1345] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:27:51.012281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e983-9f8e-47bc-8326-76b88cba357c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:51.024441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d79e983-9f8e-47bc-8326-76b88cba357c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:51.028238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:51.028902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:51.029182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:51.029452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:51.039773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:51.041270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d808ea-e4fa-4d2c-81e9-99e859f0a599 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:51.053029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 680/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:27:56.014493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecfc1-f9e8-41a1-8ba9-0c30e1a39787 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:56.015660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecfc1-f9e8-41a1-8ba9-0c30e1a39787 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:56.015660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febecfc1-f9e8-41a1-8ba9-0c30e1a39787 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:56.016400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 667/1347] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:27:56.022148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c9abe-c941-4fb1-8593-89fc3dbe575a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:56.022659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c9abe-c941-4fb1-8593-89fc3dbe575a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:56.022659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c9abe-c941-4fb1-8593-89fc3dbe575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:56.041565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-de6c9abe-c941-4fb1-8593-89fc3dbe575a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:27:56.042971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-de6c9abe-c941-4fb1-8593-89fc3dbe575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:27:56.051553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 681/1348] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:27:56.089569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecfc1-f9e8-41a1-8ba9-0c30e1a39787 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:27:56.100775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febecfc1-f9e8-41a1-8ba9-0c30e1a39787 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:27:56.104297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:27:56.104936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:27:56.105219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:27:56.105521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:27:56.115937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:27:56.117374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964faec3-d488-405b-bae4-37dc6fdb7c10 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:27:56.127764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 668/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:01.406436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d72f9-7ac8-42e4-ae48-edee877eec38 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:01.407006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d72f9-7ac8-42e4-ae48-edee877eec38 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:01.407201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d72f9-7ac8-42e4-ae48-edee877eec38 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:01.409102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 682/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:01.415101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bad4-0239-477b-b6f9-d9f2834cd2b4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:01.415981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bad4-0239-477b-b6f9-d9f2834cd2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:01.416488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3bad4-0239-477b-b6f9-d9f2834cd2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:01.498266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-57f3bad4-0239-477b-b6f9-d9f2834cd2b4 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:01.510017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-57f3bad4-0239-477b-b6f9-d9f2834cd2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:01.542481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:01.620310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 669/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:28:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:05.780918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ae7c-86eb-487b-8c79-a7b37a99eb19 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:05.781896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ae7c-86eb-487b-8c79-a7b37a99eb19 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:05.782366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707ae7c-86eb-487b-8c79-a7b37a99eb19 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:05.783777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 683/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:28:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:05.790145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061a5f-a080-4902-8495-0de2bc1e7898 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:05.790641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061a5f-a080-4902-8495-0de2bc1e7898 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:05.790641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04061a5f-a080-4902-8495-0de2bc1e7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:05.817679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-04061a5f-a080-4902-8495-0de2bc1e7898 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:05.819081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-04061a5f-a080-4902-8495-0de2bc1e7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:05.831365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 670/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:28:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:06.036561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=72 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:07.340992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07c0a-a90c-4b36-8e95-d12ff5781f1c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:07.341661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07c0a-a90c-4b36-8e95-d12ff5781f1c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:07.341661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c07c0a-a90c-4b36-8e95-d12ff5781f1c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:07.343749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 684/1354] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:07.350465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c4a4-7e23-4aa7-9255-7910135899d5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:07.350970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c4a4-7e23-4aa7-9255-7910135899d5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:07.351065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5867c4a4-7e23-4aa7-9255-7910135899d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:07.372538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5867c4a4-7e23-4aa7-9255-7910135899d5 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:07.373930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5867c4a4-7e23-4aa7-9255-7910135899d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:07.386126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 671/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:28:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:28:11.346163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe663b-f8a2-4712-a125-fc54b0b59e4e None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:11.346756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe663b-f8a2-4712-a125-fc54b0b59e4e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:11.346956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe663b-f8a2-4712-a125-fc54b0b59e4e None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:11.348807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 685/1356] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:11.354640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a622-46d5-43e9-9dc8-86a86e86f712 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:11.355516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a622-46d5-43e9-9dc8-86a86e86f712 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:11.355800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a622-46d5-43e9-9dc8-86a86e86f712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:11.392012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6b42a622-46d5-43e9-9dc8-86a86e86f712 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:11.393271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b42a622-46d5-43e9-9dc8-86a86e86f712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:11.403971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 672/1357] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:11.487829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7971-505c-4825-b063-6c3bec83dd24 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:11.488266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7971-505c-4825-b063-6c3bec83dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:11.488805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c7971-505c-4825-b063-6c3bec83dd24 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:11.491889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 686/1358] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jun 21 10:28:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:11.499602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704fb03-3da4-4e3f-bb49-7274abbd70da None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:11.501055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704fb03-3da4-4e3f-bb49-7274abbd70da None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:11.501055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2704fb03-3da4-4e3f-bb49-7274abbd70da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:11.564052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2704fb03-3da4-4e3f-bb49-7274abbd70da None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:11.565411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2704fb03-3da4-4e3f-bb49-7274abbd70da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:11.668240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 673/1359] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jun 21 10:28:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:28:11.676946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7971-505c-4825-b063-6c3bec83dd24 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:11.694847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5c7971-505c-4825-b063-6c3bec83dd24 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:11.702578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:11.703959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:11.704540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:11.704971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:11.715355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:11.717918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c3302-13fa-44bd-9f47-84a749c37468 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:11.731012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 687/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:14.414163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578d19-874e-4543-913b-2ff076bec43f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:14.414646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578d19-874e-4543-913b-2ff076bec43f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:14.414937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c578d19-874e-4543-913b-2ff076bec43f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:14.418200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 674/1361] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:14.426012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d695-1af7-4a31-af03-4073f88d07ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:14.426631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d695-1af7-4a31-af03-4073f88d07ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:14.427128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f5d695-1af7-4a31-af03-4073f88d07ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:14.451498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-77f5d695-1af7-4a31-af03-4073f88d07ba None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:14.453045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-77f5d695-1af7-4a31-af03-4073f88d07ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:14.463167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 688/1362] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:14.511340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578d19-874e-4543-913b-2ff076bec43f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:14.532927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c578d19-874e-4543-913b-2ff076bec43f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:14.538536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:14.539270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:14.539620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:14.539969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:14.549929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:14.551880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872a4ba5-64fa-49c2-82f3-702020db7a30 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:14.562619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 675/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:16.951893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99b495-0fbc-4fde-8f5b-67502fd271f6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:16.952456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99b495-0fbc-4fde-8f5b-67502fd271f6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:16.952456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99b495-0fbc-4fde-8f5b-67502fd271f6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:16.953824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 689/1364] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:16.959156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88ec8-bee5-4c12-883c-b9b3befa1653 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:16.959579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88ec8-bee5-4c12-883c-b9b3befa1653 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:16.959668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be88ec8-bee5-4c12-883c-b9b3befa1653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:16.978984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9be88ec8-bee5-4c12-883c-b9b3befa1653 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:16.980191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9be88ec8-bee5-4c12-883c-b9b3befa1653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:16.989218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 676/1365] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:17.036340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3b50-d729-4009-87b6-93076a1e4eb9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:17.036627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3b50-d729-4009-87b6-93076a1e4eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:17.037214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e3b50-d729-4009-87b6-93076a1e4eb9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:17.038889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 690/1366] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jun 21 10:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:17.044500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99bfc-2276-42d7-bbd4-78b22b57c8e4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:17.044946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99bfc-2276-42d7-bbd4-78b22b57c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:17.045549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc99bfc-2276-42d7-bbd4-78b22b57c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:17.065329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2dc99bfc-2276-42d7-bbd4-78b22b57c8e4 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:17.066549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2dc99bfc-2276-42d7-bbd4-78b22b57c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:17.076988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 677/1367] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jun 21 10:28:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:17.085420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3b50-d729-4009-87b6-93076a1e4eb9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:17.101676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e3b50-d729-4009-87b6-93076a1e4eb9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:17.108558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:17.109344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:17.109643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:17.110008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:17.122812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:17.122812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71422dc3-0973-4235-96cb-fa66c79d97df service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:17.133467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 691/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:19.318492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c7e9-f1c0-4cae-9507-f305011a62d8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:19.319200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c7e9-f1c0-4cae-9507-f305011a62d8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:19.319200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b395c7e9-f1c0-4cae-9507-f305011a62d8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:19.321525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 678/1369] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:19.328235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39b05-bb40-4877-869d-76d7ebdf925a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:19.329282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39b05-bb40-4877-869d-76d7ebdf925a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:19.329791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39b05-bb40-4877-869d-76d7ebdf925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:19.348884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a5f39b05-bb40-4877-869d-76d7ebdf925a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:19.350627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a5f39b05-bb40-4877-869d-76d7ebdf925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:19.359057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 692/1370] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:19.410696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395c7e9-f1c0-4cae-9507-f305011a62d8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:19.425857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b395c7e9-f1c0-4cae-9507-f305011a62d8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:19.431887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:19.432539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:19.432818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:19.433085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:19.442499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:19.444129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe217104-964b-4b8e-8342-5ecafa238719 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:19.455423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 679/1371] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:19.985323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2acc5-1e31-40c5-ad12-fbc125a999d7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:19.985569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2acc5-1e31-40c5-ad12-fbc125a999d7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:19.985860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2acc5-1e31-40c5-ad12-fbc125a999d7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:19.987281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 693/1372] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:28:19.992959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397a80-5ee6-4038-8230-3283943a5783 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:19.993250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397a80-5ee6-4038-8230-3283943a5783 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:19.993527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da397a80-5ee6-4038-8230-3283943a5783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:20.013687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-da397a80-5ee6-4038-8230-3283943a5783 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:20.014951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-da397a80-5ee6-4038-8230-3283943a5783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:20.024355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 680/1373] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:20.407224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9801-414b-418c-95a1-23732a686234 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:20.407224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9801-414b-418c-95a1-23732a686234 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:20.407224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef9801-414b-418c-95a1-23732a686234 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:20.407224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 694/1374] 10.222.0.43 () {54 vars in 963 bytes} [Tue Jun 21 10:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:20.412508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93159b4-c491-41f6-973b-542dcc845167 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:20.412991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93159b4-c491-41f6-973b-542dcc845167 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:20.413165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93159b4-c491-41f6-973b-542dcc845167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:20.423421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:20.477001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a93159b4-c491-41f6-973b-542dcc845167 None None] MFA Rules not processed for user `d8fcad6f0eae4e41891963dfd5b05042`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:20.478290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a93159b4-c491-41f6-973b-542dcc845167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:20.562022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 681/1375] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Jun 21 10:28:20 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:20.570141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef9801-414b-418c-95a1-23732a686234 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:20.581809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef9801-414b-418c-95a1-23732a686234 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:20.585477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:20.586397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:20.586779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:20.587162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:20.598405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:20.600075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7059c3-8792-4aaa-b3b3-38eb190649ff service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:20.610830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 695/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:21.633289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c053-5540-40d3-b009-9348525c50c5 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:21.633915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c053-5540-40d3-b009-9348525c50c5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:21.633915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326c053-5540-40d3-b009-9348525c50c5 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:21.635273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 682/1377] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:21.641067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5451e-a02d-4330-ae2b-6964356b293e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:21.641600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5451e-a02d-4330-ae2b-6964356b293e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:21.641600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5451e-a02d-4330-ae2b-6964356b293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:21.660272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0d5451e-a02d-4330-ae2b-6964356b293e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:21.661485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0d5451e-a02d-4330-ae2b-6964356b293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:21.669925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 696/1378] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:21.723164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c053-5540-40d3-b009-9348525c50c5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:21.737951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326c053-5540-40d3-b009-9348525c50c5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:21.743745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:21.744382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:21.744663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:21.744933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:21.753870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:21.755503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735adb37-16f2-4e7c-9b0e-6d8e5ba2a6ef service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:21.765191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 683/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:23.856571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e4c3-d4ce-42d1-ba7e-79881ec1abf6 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:23.857286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e4c3-d4ce-42d1-ba7e-79881ec1abf6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:23.857286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70e4c3-d4ce-42d1-ba7e-79881ec1abf6 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:23.858473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 697/1380] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:28:23.863909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47589-7d03-4388-9f97-a292422f16ac None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:23.864351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47589-7d03-4388-9f97-a292422f16ac None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:23.864470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e47589-7d03-4388-9f97-a292422f16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:23.884142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-42e47589-7d03-4388-9f97-a292422f16ac None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:23.885418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-42e47589-7d03-4388-9f97-a292422f16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:23.894320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 684/1381] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:23.942932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e4c3-d4ce-42d1-ba7e-79881ec1abf6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:23.959869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70e4c3-d4ce-42d1-ba7e-79881ec1abf6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:23.967021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:23.967844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:23.968126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:23.968533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:23.978338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:23.979948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bac722-14d1-4cf8-9a98-2f705661e040 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:23.992818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 698/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:26.118845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926737c1-5327-494f-ab91-d6a878a47a3b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:26.120066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926737c1-5327-494f-ab91-d6a878a47a3b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:26.120499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926737c1-5327-494f-ab91-d6a878a47a3b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:26.122891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 685/1383] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:26.131202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3511-a19a-4a79-b3f3-8af050931595 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:26.131681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3511-a19a-4a79-b3f3-8af050931595 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:26.132046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad3511-a19a-4a79-b3f3-8af050931595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:26.152662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6bad3511-a19a-4a79-b3f3-8af050931595 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:26.154235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6bad3511-a19a-4a79-b3f3-8af050931595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:26.162469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 699/1384] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:26.210832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926737c1-5327-494f-ab91-d6a878a47a3b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:26.227172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926737c1-5327-494f-ab91-d6a878a47a3b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:26.232688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:26.233447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:26.233820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:26.234235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:26.243569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:26.245293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebd7f8-e37d-4ec3-8a94-64df63185f52 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:26.262272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 686/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:28.364843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500de21-bcd6-4522-9e14-5e99f23c9d5c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:28.365469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500de21-bcd6-4522-9e14-5e99f23c9d5c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:28.365469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500de21-bcd6-4522-9e14-5e99f23c9d5c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:28.366941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 700/1386] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:28.373626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf54de-b1dd-47e8-9fc9-4bff4f2ccdc9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:28.374297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf54de-b1dd-47e8-9fc9-4bff4f2ccdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:28.374297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf54de-b1dd-47e8-9fc9-4bff4f2ccdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:28.393725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7adf54de-b1dd-47e8-9fc9-4bff4f2ccdc9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:28.394966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7adf54de-b1dd-47e8-9fc9-4bff4f2ccdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:28.404850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 687/1387] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:28.449772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500de21-bcd6-4522-9e14-5e99f23c9d5c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:28.465811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500de21-bcd6-4522-9e14-5e99f23c9d5c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:28.472768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:28.473438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:28.473717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:28.473976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:28.483091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:28.484747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2146490-eed8-4e1d-9f78-04674a89b4de service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:28.494386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 701/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:30.755572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b990-1ac7-43c0-b82a-3fcd13c456d4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:30.756204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b990-1ac7-43c0-b82a-3fcd13c456d4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:30.756314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b990-1ac7-43c0-b82a-3fcd13c456d4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:30.758859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 688/1389] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:30.766678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af904b-c6bd-4acc-94e8-ca72f8304be3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:30.767252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af904b-c6bd-4acc-94e8-ca72f8304be3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:30.767252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92af904b-c6bd-4acc-94e8-ca72f8304be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:30.787928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-92af904b-c6bd-4acc-94e8-ca72f8304be3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:30.789221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-92af904b-c6bd-4acc-94e8-ca72f8304be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:30.799120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 702/1390] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:30.849855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47b990-1ac7-43c0-b82a-3fcd13c456d4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:30.871115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47b990-1ac7-43c0-b82a-3fcd13c456d4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:30.878915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:30.879853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:30.880303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:30.880688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:30.893237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:30.895638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9de314-b997-4ec2-897e-98b2af9234cb service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:30.910747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 689/1391] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:33.151293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bd782-00b4-40b0-ba8b-074d926a525f None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:33.152408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bd782-00b4-40b0-ba8b-074d926a525f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:33.152408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bd782-00b4-40b0-ba8b-074d926a525f None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:33.154749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 703/1392] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:33.163067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce05e-9837-4f6d-9e38-2940a7961c34 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:33.163834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce05e-9837-4f6d-9e38-2940a7961c34 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:33.163834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ce05e-9837-4f6d-9e38-2940a7961c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:33.184349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2a0ce05e-9837-4f6d-9e38-2940a7961c34 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:33.186465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2a0ce05e-9837-4f6d-9e38-2940a7961c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:33.194752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 690/1393] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:33.243820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bd782-00b4-40b0-ba8b-074d926a525f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:33.266843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bd782-00b4-40b0-ba8b-074d926a525f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:33.272775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:33.273494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:33.273777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:33.274213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:33.287993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:33.289846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447466c-2438-452f-ab0d-0b605f721f68 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:33.305871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 704/1394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:35.418237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa1ca-9e1b-4cdc-bb34-3c4e81851d05 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:35.418832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa1ca-9e1b-4cdc-bb34-3c4e81851d05 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:35.419091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92fa1ca-9e1b-4cdc-bb34-3c4e81851d05 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:35.420714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 691/1395] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:28:35.426084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd700c-b404-45eb-906a-bed372782203 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:35.426532 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd700c-b404-45eb-906a-bed372782203 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:35.426642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efd700c-b404-45eb-906a-bed372782203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:35.445430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3efd700c-b404-45eb-906a-bed372782203 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:35.446648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3efd700c-b404-45eb-906a-bed372782203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:35.456305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 705/1396] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:35.501085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa1ca-9e1b-4cdc-bb34-3c4e81851d05 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:35.516838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92fa1ca-9e1b-4cdc-bb34-3c4e81851d05 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:35.522643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:35.523237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:35.523514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:35.523784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:35.533946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:35.535611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a979-79ff-4320-8690-bdbc63952b4e service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:35.546524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 692/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:36.042206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc95c9-7115-4f72-a81e-f9c9208afc8b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:36.042490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc95c9-7115-4f72-a81e-f9c9208afc8b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:36.042795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc95c9-7115-4f72-a81e-f9c9208afc8b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:36.044918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 706/1398] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:36.050728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351728cd-25ad-4ff4-ba8d-288f205b0844 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:36.051041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351728cd-25ad-4ff4-ba8d-288f205b0844 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:36.051373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351728cd-25ad-4ff4-ba8d-288f205b0844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:36.073029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-351728cd-25ad-4ff4-ba8d-288f205b0844 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:36.074272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-351728cd-25ad-4ff4-ba8d-288f205b0844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:36.083596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 693/1399] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:36.142945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ac80-9958-4fa0-ad0b-19c61fdbf835 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:36.143191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ac80-9958-4fa0-ad0b-19c61fdbf835 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:36.143496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1557ac80-9958-4fa0-ad0b-19c61fdbf835 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:36.144881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 707/1400] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jun 21 10:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:36.150341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beb0b-1035-48d4-b4fa-d5299b1217e7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:36.150629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beb0b-1035-48d4-b4fa-d5299b1217e7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:36.150904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4beb0b-1035-48d4-b4fa-d5299b1217e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:36.203511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4e4beb0b-1035-48d4-b4fa-d5299b1217e7 None None] MFA Rules not processed for user `ee05ef1224e94100b841074a1ea6727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:36.204755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4e4beb0b-1035-48d4-b4fa-d5299b1217e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:36.245592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:36.283611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 694/1401] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jun 21 10:28:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:36.291597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ac80-9958-4fa0-ad0b-19c61fdbf835 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:36.298134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=55 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:36.305261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1557ac80-9958-4fa0-ad0b-19c61fdbf835 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:36.309731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:36.310631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:36.310919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:36.311226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:36.321857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:36.323550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac2030-1f05-4a13-b556-84ddfe94ab58 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:36.334478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 708/1402] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:37.088259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9152-3cab-4a07-924c-beff21565e0c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.088838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9152-3cab-4a07-924c-beff21565e0c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.088838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bef9152-3cab-4a07-924c-beff21565e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.148164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1bef9152-3cab-4a07-924c-beff21565e0c None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:37.149853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1bef9152-3cab-4a07-924c-beff21565e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:37.220947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 695/1403] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:37.268097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840393-1d3e-48d9-88c9-f6ae95a8f057 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.268866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840393-1d3e-48d9-88c9-f6ae95a8f057 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.268866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67840393-1d3e-48d9-88c9-f6ae95a8f057 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.270535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 709/1404] 10.222.0.43 () {54 vars in 942 bytes} [Tue Jun 21 10:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:37.279151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558dc2-101c-430c-8bb1-80d81da159ee None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.279466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558dc2-101c-430c-8bb1-80d81da159ee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.279742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36558dc2-101c-430c-8bb1-80d81da159ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.331558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-36558dc2-101c-430c-8bb1-80d81da159ee None None] MFA Rules not processed for user `965fa890ec864b0c870bba47db2f7ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:37.332786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-36558dc2-101c-430c-8bb1-80d81da159ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:37.424279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 696/1405] 10.222.0.43 () {58 vars in 1039 bytes} [Tue Jun 21 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:28:37.434259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840393-1d3e-48d9-88c9-f6ae95a8f057 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:37.447989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67840393-1d3e-48d9-88c9-f6ae95a8f057 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:37.453150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:37.453804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.454116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.454384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.463521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:37.465186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3083ea40-2958-40ab-b190-7be8e1ff3ef0 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:37.476036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 710/1406] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:28:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:28:37.727937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110d4b-82f9-439f-8612-e7bb33f1a60a None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.728151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110d4b-82f9-439f-8612-e7bb33f1a60a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.728457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4110d4b-82f9-439f-8612-e7bb33f1a60a None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.729966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 697/1407] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:28:37.736478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496464e-612a-44f6-866d-940e3aa98636 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.736724 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496464e-612a-44f6-866d-940e3aa98636 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.737026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496464e-612a-44f6-866d-940e3aa98636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.759228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3496464e-612a-44f6-866d-940e3aa98636 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:28:37.760452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3496464e-612a-44f6-866d-940e3aa98636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:28:37.769196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 711/1408] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:28:37.815648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110d4b-82f9-439f-8612-e7bb33f1a60a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:28:37.834230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4110d4b-82f9-439f-8612-e7bb33f1a60a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:28:37.841843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:28:37.842567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:28:37.843269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:28:37.843560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:28:37.853736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:28:37.857898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a058087-581d-4ecf-925e-22f400daf26c service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:28:37.865783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:28:37.873475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 698/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:28:47.753261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=14 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:01.118236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28580-660a-4e0e-be8a-e8d6322ddd97 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:01.118913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28580-660a-4e0e-be8a-e8d6322ddd97 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:01.118913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb28580-660a-4e0e-be8a-e8d6322ddd97 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:01.120262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 712/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jun 21 10:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:01.125879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fc92a-2449-4c0b-a3a2-33dd10429c47 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:01.126406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fc92a-2449-4c0b-a3a2-33dd10429c47 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:01.126515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fc92a-2449-4c0b-a3a2-33dd10429c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:01.147023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9e0fc92a-2449-4c0b-a3a2-33dd10429c47 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:01.148255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9e0fc92a-2449-4c0b-a3a2-33dd10429c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:01.158099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 699/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jun 21 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:01.173992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f8eb-4d22-48ba-947d-598500682618 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:01.174300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f8eb-4d22-48ba-947d-598500682618 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:01.174576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e166f8eb-4d22-48ba-947d-598500682618 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:01.175978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 713/1412] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jun 21 10:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:01.181191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e62b-5378-48b8-9d72-23cff77e1d9c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:01.181433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e62b-5378-48b8-9d72-23cff77e1d9c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:01.181701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1e62b-5378-48b8-9d72-23cff77e1d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:01.201909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0fd1e62b-5378-48b8-9d72-23cff77e1d9c None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:01.203150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fd1e62b-5378-48b8-9d72-23cff77e1d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:01.214624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 700/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jun 21 10:29:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:29:03.831877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b002f-2fbc-456d-804f-0059cf1ac114 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:03.832447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b002f-2fbc-456d-804f-0059cf1ac114 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:03.832447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7b002f-2fbc-456d-804f-0059cf1ac114 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:03.833676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:03.839296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b216-4fca-4fd5-9c70-6084c220cef5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:03.839762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b216-4fca-4fd5-9c70-6084c220cef5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:03.839866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b216-4fca-4fd5-9c70-6084c220cef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:03.861088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c470b216-4fca-4fd5-9c70-6084c220cef5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:03.862344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c470b216-4fca-4fd5-9c70-6084c220cef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:03.871579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:03.915655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b002f-2fbc-456d-804f-0059cf1ac114 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:03.934953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7b002f-2fbc-456d-804f-0059cf1ac114 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:03.940600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:03.941268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:03.941544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:03.941816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:03.951087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:03.952693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d362-025a-4bfb-850a-6d45ca45318f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:03.963149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 715/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:04.896691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199680-32c2-4270-b594-2cfac10f449e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:04.897296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199680-32c2-4270-b594-2cfac10f449e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:04.897296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4199680-32c2-4270-b594-2cfac10f449e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:04.898660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:04.903972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982618c-9f70-4dd5-94a7-4c3bf0b53923 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:04.904468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982618c-9f70-4dd5-94a7-4c3bf0b53923 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:04.904564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1982618c-9f70-4dd5-94a7-4c3bf0b53923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:04.924300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1982618c-9f70-4dd5-94a7-4c3bf0b53923 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:04.925500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1982618c-9f70-4dd5-94a7-4c3bf0b53923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:04.935143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:05.090442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199680-32c2-4270-b594-2cfac10f449e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:05.106899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4199680-32c2-4270-b594-2cfac10f449e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:05.112265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:05.112916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:05.113193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:05.113481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:05.122865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:05.124509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d5196-ae1e-41ca-a6a4-321fc569b977 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:05.134846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 703/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:06.043521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaaad6-59d8-48a5-a203-322ca441dbc9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:06.044117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaaad6-59d8-48a5-a203-322ca441dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:06.044117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaaad6-59d8-48a5-a203-322ca441dbc9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:06.045492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:06.051137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254aa74-a1c8-40e9-8383-a62307d49455 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:06.051599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254aa74-a1c8-40e9-8383-a62307d49455 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:06.051704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9254aa74-a1c8-40e9-8383-a62307d49455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:06.071042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9254aa74-a1c8-40e9-8383-a62307d49455 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:06.072253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9254aa74-a1c8-40e9-8383-a62307d49455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:06.081409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:06.233672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaaad6-59d8-48a5-a203-322ca441dbc9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:06.249238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eaaad6-59d8-48a5-a203-322ca441dbc9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:06.255040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:06.255686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:06.255967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:06.256243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:06.265490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:06.267151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9afc5c8-b4e5-4413-8de2-cb59299985e9 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:06.278614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 718/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:07.159993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62052fd-1d53-4430-88bd-87400cda39fe None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:07.160627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62052fd-1d53-4430-88bd-87400cda39fe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:07.160627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62052fd-1d53-4430-88bd-87400cda39fe None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:07.161954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:07.167628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0bfad-f3a6-40c1-b24a-fae4f990713e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:07.168149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0bfad-f3a6-40c1-b24a-fae4f990713e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:07.168149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0bfad-f3a6-40c1-b24a-fae4f990713e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:07.188653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a9f0bfad-f3a6-40c1-b24a-fae4f990713e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:07.189974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a9f0bfad-f3a6-40c1-b24a-fae4f990713e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:07.199715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:07.352633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62052fd-1d53-4430-88bd-87400cda39fe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:07.368684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62052fd-1d53-4430-88bd-87400cda39fe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:07.374937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:07.375595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:07.375873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:07.376146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:07.385129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:07.386796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29824bc-ca16-4c28-87a9-21bae1cc9163 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:07.397117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 706/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:08.275524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972767-548d-4719-b741-5c4a996d6dbd None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:08.275997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972767-548d-4719-b741-5c4a996d6dbd None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:08.276133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d972767-548d-4719-b741-5c4a996d6dbd None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:08.277527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:08.283270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505245b-bee3-4834-b484-103df4e18e48 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:08.284112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505245b-bee3-4834-b484-103df4e18e48 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:08.284428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505245b-bee3-4834-b484-103df4e18e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:08.305341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4505245b-bee3-4834-b484-103df4e18e48 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:08.306646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4505245b-bee3-4834-b484-103df4e18e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:08.315894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:08.468476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972767-548d-4719-b741-5c4a996d6dbd None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:08.484631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d972767-548d-4719-b741-5c4a996d6dbd None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:08.490998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:08.491666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:08.491945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:08.492224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:08.502116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:08.503752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc86b18-3665-44f7-bc86-a9704203207e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:08.515228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 721/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:09.343493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df8-58ae-4ba1-8ea2-55c912008650 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:09.344064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df8-58ae-4ba1-8ea2-55c912008650 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:09.344064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb06df8-58ae-4ba1-8ea2-55c912008650 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:09.345798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:09.351326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85d8a-05e6-44e7-8623-db4654d85bd7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:09.351814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85d8a-05e6-44e7-8623-db4654d85bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:09.351955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa85d8a-05e6-44e7-8623-db4654d85bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:09.371996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4aa85d8a-05e6-44e7-8623-db4654d85bd7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:09.373214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4aa85d8a-05e6-44e7-8623-db4654d85bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:09.382384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:09.534030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06df8-58ae-4ba1-8ea2-55c912008650 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:09.550844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb06df8-58ae-4ba1-8ea2-55c912008650 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:09.557586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:09.558272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:09.558556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:09.558828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:09.568314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:09.569940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f95a6-ffcb-4aa6-ad9f-5b2059dcc386 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:09.580477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 709/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:10.435659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e16e40-1f74-4638-a279-2cfaf738c38c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:10.436264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e16e40-1f74-4638-a279-2cfaf738c38c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:10.436264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e16e40-1f74-4638-a279-2cfaf738c38c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:10.437578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:10.442717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea929e-a77e-4608-912a-59ea7ee15151 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:10.443177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea929e-a77e-4608-912a-59ea7ee15151 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:10.443280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ea929e-a77e-4608-912a-59ea7ee15151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:10.462225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e2ea929e-a77e-4608-912a-59ea7ee15151 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:10.463608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e2ea929e-a77e-4608-912a-59ea7ee15151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:10.474086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:10.625982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e16e40-1f74-4638-a279-2cfaf738c38c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:10.642769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e16e40-1f74-4638-a279-2cfaf738c38c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:10.648661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:10.649322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:10.649599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:10.649870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:10.659247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:10.660733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413678b1-b5fc-486a-98c4-6630a158c936 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:10.670810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 724/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:11.499726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d05c7c-ce6c-4839-8ebd-22b3b9733df4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:11.500288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d05c7c-ce6c-4839-8ebd-22b3b9733df4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:11.500288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d05c7c-ce6c-4839-8ebd-22b3b9733df4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:11.501735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:11.507284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db24136-5970-472b-ac62-2132d38531b1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:11.507742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db24136-5970-472b-ac62-2132d38531b1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:11.507989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db24136-5970-472b-ac62-2132d38531b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:11.527477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6db24136-5970-472b-ac62-2132d38531b1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:11.528614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6db24136-5970-472b-ac62-2132d38531b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:11.537192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:11.687821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d05c7c-ce6c-4839-8ebd-22b3b9733df4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:11.703195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d05c7c-ce6c-4839-8ebd-22b3b9733df4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:11.709335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:11.709996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:11.710288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:11.710563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:11.720240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:11.721840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952ba35-a591-493f-a859-5d9618d2a134 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:11.731573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 712/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:12.547959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd34ea-23d3-4e93-a3f1-9a21285d0bbc None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:12.548506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd34ea-23d3-4e93-a3f1-9a21285d0bbc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:12.548506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd34ea-23d3-4e93-a3f1-9a21285d0bbc None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:12.549912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:12.555321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85a8c-3933-4bcc-9f1b-e781e5e58980 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:12.555725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85a8c-3933-4bcc-9f1b-e781e5e58980 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:12.555984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad85a8c-3933-4bcc-9f1b-e781e5e58980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:12.575752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1ad85a8c-3933-4bcc-9f1b-e781e5e58980 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:12.577027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1ad85a8c-3933-4bcc-9f1b-e781e5e58980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:12.586526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:12.738013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd34ea-23d3-4e93-a3f1-9a21285d0bbc None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:12.753765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd34ea-23d3-4e93-a3f1-9a21285d0bbc None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:12.759961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:12.761009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:12.761295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:12.761571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:12.770727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:12.772383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8464313-75f8-4a44-a5f8-ac66a055e4b0 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:12.783218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 727/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:14.743547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf66f-68da-4360-94ec-31d4af94419c None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:14.744182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf66f-68da-4360-94ec-31d4af94419c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:14.744182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcf66f-68da-4360-94ec-31d4af94419c None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:14.745588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:14.751318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896f03-b32a-4aeb-a6d1-411a2b439b58 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:14.751797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896f03-b32a-4aeb-a6d1-411a2b439b58 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:14.751905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00896f03-b32a-4aeb-a6d1-411a2b439b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:14.771468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-00896f03-b32a-4aeb-a6d1-411a2b439b58 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:14.772720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-00896f03-b32a-4aeb-a6d1-411a2b439b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:14.781842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:29:14.821775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf66f-68da-4360-94ec-31d4af94419c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:14.834235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcf66f-68da-4360-94ec-31d4af94419c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:14.838704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:14.839363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:14.839644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:14.839918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:14.850681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:14.852152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e13a2c-c616-42ee-9834-50269bfcb5f1 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:14.861894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 715/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:17.060731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d089-2461-472f-b918-b12afb1991e0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:17.061402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d089-2461-472f-b918-b12afb1991e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:17.061402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96d089-2461-472f-b918-b12afb1991e0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:17.062699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:17.068679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284458b6-2467-4e43-9708-5f37037579bc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:17.069126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284458b6-2467-4e43-9708-5f37037579bc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:17.069318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284458b6-2467-4e43-9708-5f37037579bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:17.090455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-284458b6-2467-4e43-9708-5f37037579bc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:17.091681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-284458b6-2467-4e43-9708-5f37037579bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:17.101184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:17.143036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d089-2461-472f-b918-b12afb1991e0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:17.157370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96d089-2461-472f-b918-b12afb1991e0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:17.161212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:17.161867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:17.162182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:17.162457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:17.172738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:17.174208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452b151a-0dcf-4476-aa9e-de480b30edf4 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:17.184263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 730/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:19.733953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75954063-628e-4cd1-a2a9-0684b7aea75f None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:19.734649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75954063-628e-4cd1-a2a9-0684b7aea75f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:19.734649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75954063-628e-4cd1-a2a9-0684b7aea75f None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:19.735978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:29:19.742026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad61cf-d545-40ba-8abc-0613d9334229 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:19.742600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad61cf-d545-40ba-8abc-0613d9334229 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:19.742600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ad61cf-d545-40ba-8abc-0613d9334229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:19.761709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-67ad61cf-d545-40ba-8abc-0613d9334229 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:19.763149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-67ad61cf-d545-40ba-8abc-0613d9334229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:19.772872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:19.817325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75954063-628e-4cd1-a2a9-0684b7aea75f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:19.830789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75954063-628e-4cd1-a2a9-0684b7aea75f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:19.835764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:19.836317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:19.836591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:19.836866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:19.848353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:19.849859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d76b6c-ac67-4ba0-ad01-b4de47e8d4ad service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:19.862989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 718/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:22.125679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:22.126375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:22.126375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:22.127846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:22.133524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3e8f-72d0-4aaf-86d6-d7d1916e1dd4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:22.134047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3e8f-72d0-4aaf-86d6-d7d1916e1dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:22.134047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c3e8f-72d0-4aaf-86d6-d7d1916e1dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:22.170020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eb0c3e8f-72d0-4aaf-86d6-d7d1916e1dd4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:22.171865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eb0c3e8f-72d0-4aaf-86d6-d7d1916e1dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:22.183564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:22.226530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:22.228546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:22.244513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7177a-535c-4471-a178-34bfad94f348 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:22.248659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:22.249336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:22.249619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:22.249896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:22.261246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:22.263032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecd28dd-7a9d-480d-b62a-ef7fd67abc0c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:22.274605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 733/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:29:24.505988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03f58-6bf0-4c77-9507-6c23f545ff82 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:24.506820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03f58-6bf0-4c77-9507-6c23f545ff82 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:24.506820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c03f58-6bf0-4c77-9507-6c23f545ff82 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:24.508022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:24.514954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592fb1-31b0-4ac2-8ccf-0c7ef99f188b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:24.515545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592fb1-31b0-4ac2-8ccf-0c7ef99f188b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:24.515545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2592fb1-31b0-4ac2-8ccf-0c7ef99f188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:24.537668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c2592fb1-31b0-4ac2-8ccf-0c7ef99f188b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:24.538940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c2592fb1-31b0-4ac2-8ccf-0c7ef99f188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:24.547390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:29:24.585385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03f58-6bf0-4c77-9507-6c23f545ff82 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:24.597733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c03f58-6bf0-4c77-9507-6c23f545ff82 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:24.601381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:24.602039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:24.602376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:24.602652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:24.612577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:24.614074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5671ab-47b1-43eb-bab4-a328f9591ddc service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:24.625158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 721/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:29:26.785511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f599-fbf3-42d9-a4e1-9397b0aeaac0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:26.786144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f599-fbf3-42d9-a4e1-9397b0aeaac0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:26.786144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1f599-fbf3-42d9-a4e1-9397b0aeaac0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:26.787468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:26.793255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13cf6-7224-47cc-9fe6-181249a9a798 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:26.793776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13cf6-7224-47cc-9fe6-181249a9a798 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:26.793874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c13cf6-7224-47cc-9fe6-181249a9a798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:26.812652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-19c13cf6-7224-47cc-9fe6-181249a9a798 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:26.813878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-19c13cf6-7224-47cc-9fe6-181249a9a798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:26.821995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:26.863855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1f599-fbf3-42d9-a4e1-9397b0aeaac0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:26.875677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1f599-fbf3-42d9-a4e1-9397b0aeaac0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:26.884739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:26.885404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:26.885681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:26.885950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:26.896826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:26.898335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795abed4-3a4c-45bc-bdd7-abed8c414812 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:26.909140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 736/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:29.061843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8615fd2-e53e-4d21-a06d-d4f4310667fa None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:29.062466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8615fd2-e53e-4d21-a06d-d4f4310667fa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:29.062466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8615fd2-e53e-4d21-a06d-d4f4310667fa None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:29.063906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:29.070086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df633-ae7f-467c-a6b0-4a1d4e8f8b67 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:29.070608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df633-ae7f-467c-a6b0-4a1d4e8f8b67 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:29.070721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7df633-ae7f-467c-a6b0-4a1d4e8f8b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:29.077882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=70 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:29.093301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb7df633-ae7f-467c-a6b0-4a1d4e8f8b67 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:29.094937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb7df633-ae7f-467c-a6b0-4a1d4e8f8b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:29.103591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:29.145379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8615fd2-e53e-4d21-a06d-d4f4310667fa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:29.151378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=73 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:29.158988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8615fd2-e53e-4d21-a06d-d4f4310667fa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:29.162844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:29.163522 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:29.163791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:29.164069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:29.174595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:29.176083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3603a8-502b-4dba-a5ad-ba8c481d70fe service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:29.187018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 724/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:31.352817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f574d-76a2-461c-a9ad-a2c7d245d696 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:31.353414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f574d-76a2-461c-a9ad-a2c7d245d696 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:31.353414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f574d-76a2-461c-a9ad-a2c7d245d696 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:31.354891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:31.361203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db684a-f41e-4af2-b7dd-706e5c02fc31 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:31.361771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db684a-f41e-4af2-b7dd-706e5c02fc31 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:31.361771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db684a-f41e-4af2-b7dd-706e5c02fc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:31.380782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-76db684a-f41e-4af2-b7dd-706e5c02fc31 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:31.382206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-76db684a-f41e-4af2-b7dd-706e5c02fc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:31.394090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:31.434330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f574d-76a2-461c-a9ad-a2c7d245d696 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:31.445574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f574d-76a2-461c-a9ad-a2c7d245d696 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:31.449490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:31.450174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:31.450458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:31.450723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:31.461034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:31.462681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3c192-105f-417a-8033-b9a49ab71ac0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:31.474515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 739/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:33.683944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d64fe-9a08-46bb-9787-f4bb981d797b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:33.684616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d64fe-9a08-46bb-9787-f4bb981d797b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:33.684616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d64fe-9a08-46bb-9787-f4bb981d797b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:33.686023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:33.692265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec29e1-707d-4d41-86bb-db70aaa954a8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:33.693025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec29e1-707d-4d41-86bb-db70aaa954a8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:33.693025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec29e1-707d-4d41-86bb-db70aaa954a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:33.712676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a1ec29e1-707d-4d41-86bb-db70aaa954a8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:33.714929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a1ec29e1-707d-4d41-86bb-db70aaa954a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:33.723921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:33.762440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d64fe-9a08-46bb-9787-f4bb981d797b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:33.776002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d64fe-9a08-46bb-9787-f4bb981d797b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:33.780046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:33.780708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:33.780994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:33.781268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:33.792229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:33.793782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6e2db-6885-4350-af50-22a3352ed299 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:33.805044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 727/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:29:36.225074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08da9-5a58-4ae3-8103-4e49d9effd3c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:36.225653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08da9-5a58-4ae3-8103-4e49d9effd3c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:36.225653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a08da9-5a58-4ae3-8103-4e49d9effd3c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:36.227441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:29:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:36.233924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825ba1-bd5b-4651-849f-02b6a96322f0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:36.234776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825ba1-bd5b-4651-849f-02b6a96322f0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:36.234776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff825ba1-bd5b-4651-849f-02b6a96322f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:36.254900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ff825ba1-bd5b-4651-849f-02b6a96322f0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:36.256196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ff825ba1-bd5b-4651-849f-02b6a96322f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:36.265810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:29:36.305873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a08da9-5a58-4ae3-8103-4e49d9effd3c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:36.318535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a08da9-5a58-4ae3-8103-4e49d9effd3c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:36.323500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:36.324156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:36.324435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:36.324707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:36.334672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:36.336251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08f848-2081-4692-8a8d-ce259503cadf service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:36.347061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 742/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:46.248570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=17 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:46.342286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=17 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:29:57.207037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72a99-de96-4e7e-a98c-332d427538ff None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:57.207763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72a99-de96-4e7e-a98c-332d427538ff None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:57.207763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a72a99-de96-4e7e-a98c-332d427538ff None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:57.208970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 729/1471] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:57.216414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5374f-2071-4d4a-abd4-4383e6b0fbb1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:57.217213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5374f-2071-4d4a-abd4-4383e6b0fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:57.217771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5374f-2071-4d4a-abd4-4383e6b0fbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:57.238725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1ff5374f-2071-4d4a-abd4-4383e6b0fbb1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:57.239980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ff5374f-2071-4d4a-abd4-4383e6b0fbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:57.248803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 743/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:29:57.298514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a3fa-27e6-4825-a677-3e1b5c38c3d4 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:57.298917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a3fa-27e6-4825-a677-3e1b5c38c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:57.299288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7a3fa-27e6-4825-a677-3e1b5c38c3d4 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:57.300876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 730/1473] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jun 21 10:29:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:57.306208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fc2c-b352-41df-b5b8-a3e6a8d1ed0d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:57.306498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fc2c-b352-41df-b5b8-a3e6a8d1ed0d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:57.306775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf92fc2c-b352-41df-b5b8-a3e6a8d1ed0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:57.327177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bf92fc2c-b352-41df-b5b8-a3e6a8d1ed0d None None] MFA Rules not processed for user `ee05ef1224e94100b841074a1ea6727c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:57.328387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bf92fc2c-b352-41df-b5b8-a3e6a8d1ed0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:57.335244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 744/1474] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jun 21 10:29:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:57.343479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a3fa-27e6-4825-a677-3e1b5c38c3d4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:57.355575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7a3fa-27e6-4825-a677-3e1b5c38c3d4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:57.359297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:57.359943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:57.360226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:57.360507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:57.370124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:57.371608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0235b95c-cc81-4b05-9376-cd4a406987bf service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:57.381911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 731/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:29:59.575465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5e64-3654-433b-9938-cbb45cb9bac0 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:59.576354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5e64-3654-433b-9938-cbb45cb9bac0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:59.576539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd5e64-3654-433b-9938-cbb45cb9bac0 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:59.578042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 745/1476] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:29:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:29:59.584063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08669-67d7-4731-88ec-147bc04eed6c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:59.584565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08669-67d7-4731-88ec-147bc04eed6c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:59.584669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be08669-67d7-4731-88ec-147bc04eed6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:59.604152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5be08669-67d7-4731-88ec-147bc04eed6c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:29:59.605348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5be08669-67d7-4731-88ec-147bc04eed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:29:59.614043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 732/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:29:59.638985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5e64-3654-433b-9938-cbb45cb9bac0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:29:59.654206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd5e64-3654-433b-9938-cbb45cb9bac0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:29:59.659426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:29:59.660105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:29:59.660418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:29:59.660686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:29:59.661430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:29:59.663313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:29:59.663313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:29:59.663313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:29:59.664593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376419b6-ce69-4de5-bb62-7df5d443bdca admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:29:59.685561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 746/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jun 21 10:29:59 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:30:02.026694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a44a-ca97-42c9-ab4b-0254ff2dbe60 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:02.027284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a44a-ca97-42c9-ab4b-0254ff2dbe60 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:02.027284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348a44a-ca97-42c9-ab4b-0254ff2dbe60 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:02.029227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 733/1479] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:30:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:30:02.037208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a1d4-99e3-4b15-acb6-cad02ddc22aa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:02.037812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a1d4-99e3-4b15-acb6-cad02ddc22aa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:02.037941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54a1d4-99e3-4b15-acb6-cad02ddc22aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:02.060728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa54a1d4-99e3-4b15-acb6-cad02ddc22aa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:30:02.062155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa54a1d4-99e3-4b15-acb6-cad02ddc22aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:30:02.072202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 747/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:30:02.144799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348a44a-ca97-42c9-ab4b-0254ff2dbe60 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:30:02.170850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348a44a-ca97-42c9-ab4b-0254ff2dbe60 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:30:02.176791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:30:02.177470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:02.177757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:02.178029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:02.195308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:30:02.200589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f4d90-60aa-4345-bb99-2c2f78c38de9 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:30:02.215631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 734/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:30:04.540869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd194b-bca5-41ae-a488-11a685c81e10 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:04.541422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd194b-bca5-41ae-a488-11a685c81e10 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:04.541422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd194b-bca5-41ae-a488-11a685c81e10 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:04.542843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 748/1482] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:30:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:30:04.549749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8837e-8dbb-4522-8127-71b03fe56bea None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:04.550301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8837e-8dbb-4522-8127-71b03fe56bea None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:04.550301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8837e-8dbb-4522-8127-71b03fe56bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:04.569767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0fc8837e-8dbb-4522-8127-71b03fe56bea None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:30:04.571220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fc8837e-8dbb-4522-8127-71b03fe56bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:30:04.580228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 735/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:30:04.620885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd194b-bca5-41ae-a488-11a685c81e10 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:30:04.632531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd194b-bca5-41ae-a488-11a685c81e10 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:30:04.636539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:30:04.637226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:04.637495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:04.637775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:04.649883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:30:04.651429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35fdc0-c486-444b-9aac-4b2ada4b1295 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:30:04.662630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 749/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:30:06.876719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e0a9-041b-4464-be8c-7923152caea6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:06.877270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e0a9-041b-4464-be8c-7923152caea6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:06.877270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39e0a9-041b-4464-be8c-7923152caea6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:06.878696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 736/1485] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:30:06.884982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35942b2e-2721-4e60-b7dc-ceff4bb8f2e0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:06.885444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35942b2e-2721-4e60-b7dc-ceff4bb8f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:06.885578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35942b2e-2721-4e60-b7dc-ceff4bb8f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:06.905011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-35942b2e-2721-4e60-b7dc-ceff4bb8f2e0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:30:06.906248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-35942b2e-2721-4e60-b7dc-ceff4bb8f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:30:06.915085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 750/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:30:06.953733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e0a9-041b-4464-be8c-7923152caea6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:30:06.966427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39e0a9-041b-4464-be8c-7923152caea6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:30:06.970928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:30:06.971596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:06.971876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:06.972149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:06.983317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:30:06.984790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6768d-e6a4-44c6-b5ba-1f1a2572aeff service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:30:06.995208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 737/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:30:09.166833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893d0d-f74a-4972-b67d-2365a8067c86 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:09.167487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893d0d-f74a-4972-b67d-2365a8067c86 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:09.167487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6893d0d-f74a-4972-b67d-2365a8067c86 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:09.168986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 751/1488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:30:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:30:09.174816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063925-9a78-4ad5-9680-a188f1f7e677 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:09.175343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063925-9a78-4ad5-9680-a188f1f7e677 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:09.175460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16063925-9a78-4ad5-9680-a188f1f7e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:09.195460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-16063925-9a78-4ad5-9680-a188f1f7e677 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:30:09.196764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-16063925-9a78-4ad5-9680-a188f1f7e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:30:09.205780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 738/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:30:09.248200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893d0d-f74a-4972-b67d-2365a8067c86 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:30:09.260106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6893d0d-f74a-4972-b67d-2365a8067c86 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:30:09.264070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:30:09.264740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:09.265013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:09.265282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:09.277039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:30:09.278566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fdf51d-59e7-442f-b643-ca651509d37d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:30:09.289112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 752/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:30:11.775869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfea53-7ac2-4742-9ff7-f537fd50e6f8 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:11.776466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfea53-7ac2-4742-9ff7-f537fd50e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:11.776466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfea53-7ac2-4742-9ff7-f537fd50e6f8 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:11.777817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 739/1491] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jun 21 10:30:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:30:11.783378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73744-d911-494c-bdb0-b58b3a0892b4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:11.783878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73744-d911-494c-bdb0-b58b3a0892b4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:11.784005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b73744-d911-494c-bdb0-b58b3a0892b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:11.801972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-32b73744-d911-494c-bdb0-b58b3a0892b4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:30:11.803223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-32b73744-d911-494c-bdb0-b58b3a0892b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:30:11.811358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 753/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jun 21 10:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:30:11.850861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfea53-7ac2-4742-9ff7-f537fd50e6f8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:30:11.861736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfea53-7ac2-4742-9ff7-f537fd50e6f8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:30:11.865407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:30:11.866042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:30:11.866365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:30:11.866622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:30:11.876682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:30:11.878074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3524a9-20fe-452b-ac0c-66c99259bf3f service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:30:11.888509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 740/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:30:21.796663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=33 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:30:21.883949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=33 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:31:46.947323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:46.947961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:46.947961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:46.969145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:31:46.970382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:46.978827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 754/1494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:31:46.988416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:46.989134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:46.989134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.007925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:31:47.009118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:47.018567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 741/1495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:31:47.023680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.034164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb5cd63-3eb2-4610-86bf-20b9e5b0459c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.039302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.039980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.040260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.040533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.041273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:31:47.041583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.042644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.042644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:31:47.042644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:31:47.043540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.056876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 755/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:31:47.065413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.075950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3aaaa4-6b07-4e14-b593-c9fdd4ed1e7b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.080925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.081591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.081976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.082325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.083230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.085064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.085064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:31:47.085064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:31:47.086313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.127547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 742/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:31:47 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:31:47.132427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.143059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f8efb-dd9b-4832-8e23-c0b9436fb54c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.205352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.205956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.206272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.206538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.207709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.208690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.208690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:31:47.208690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:31:47.209911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.233129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 756/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:31:47 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:31:47.237422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.248457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1cfc3-ae8d-42ba-a84a-880f3950c90e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.253105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.254210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.254502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.254754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.255502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.256553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.256553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:31:47.256553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:31:47.257455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.271283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 743/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:31:47.275653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.286357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532a7bf-61c4-4ee3-9bcb-068cf4110969 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.291669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.292334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.292610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.292879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.293614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.294680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.294680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:31:47.294680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:31:47.295556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f1ebc-427c-4eb0-be41-18f7f4ac78c0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.310248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 757/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:31:47.314924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.325713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a0f40-0612-4533-91c2-658458c9573b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.331717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.332690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.332946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.333225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] PATH_INFO: `/v3/projects/b815d48d5118496ab4a916024949a8c7/users/b12a960c8f4b40429f72e81c18613249/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.349861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b815d48d5118496ab4a916024949a8c7, user_id=b12a960c8f4b40429f72e81c18613249, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.350963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.350963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:31:47.350963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:31:47.352902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31726992-7eb5-4eff-a1d9-b8cf02988143 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.366838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 744/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:31:47 2022] PUT /identity/v3/projects/b815d48d5118496ab4a916024949a8c7/users/b12a960c8f4b40429f72e81c18613249/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:31:47.378578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c65fc-2e69-4307-90f8-a772879aee15 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.379651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c65fc-2e69-4307-90f8-a772879aee15 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.379651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c65fc-2e69-4307-90f8-a772879aee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.414691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2a9c65fc-2e69-4307-90f8-a772879aee15 None None] MFA Rules not processed for user `b12a960c8f4b40429f72e81c18613249`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:31:47.415977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a9c65fc-2e69-4307-90f8-a772879aee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:47.494200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 758/1502] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:31:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:31:47.508494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aebaa-142f-4a74-b3ca-d636911dd2c6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.508798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aebaa-142f-4a74-b3ca-d636911dd2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.509072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aebaa-142f-4a74-b3ca-d636911dd2c6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.510485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 745/1503] 10.222.0.43 () {54 vars in 963 bytes} [Tue Jun 21 10:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:31:47.516484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721284-7bb3-40e5-8f47-df7bf73fa4ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.516856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721284-7bb3-40e5-8f47-df7bf73fa4ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.517247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721284-7bb3-40e5-8f47-df7bf73fa4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.542034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c1721284-7bb3-40e5-8f47-df7bf73fa4ba None None] MFA Rules not processed for user `d8fcad6f0eae4e41891963dfd5b05042`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:31:47.543314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c1721284-7bb3-40e5-8f47-df7bf73fa4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:47.590004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:31:47.599989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 759/1504] 10.222.0.43 () {58 vars in 1060 bytes} [Tue Jun 21 10:31:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:31:47.607875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aebaa-142f-4a74-b3ca-d636911dd2c6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.619161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aebaa-142f-4a74-b3ca-d636911dd2c6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.622861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.623507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.623786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.624059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.632992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.634542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.643936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 746/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:31:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:31:47.686888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3a59-44ab-466c-a8d2-c0f182cade26 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.687175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3a59-44ab-466c-a8d2-c0f182cade26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.687455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3a59-44ab-466c-a8d2-c0f182cade26 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.688761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 760/1506] 10.222.0.43 () {52 vars in 829 bytes} [Tue Jun 21 10:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:31:47.692983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.759749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d116a6-be38-4501-a27f-a97364243c65 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:47.765054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:47.765932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.766232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.766507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] PATH_INFO: `/v3/users/b12a960c8f4b40429f72e81c18613249` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.767722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b12a960c8f4b40429f72e81c18613249)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:47.768757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:47.768757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:31:47.768757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:31:47.770314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:47.839924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b12a960c8f4b40429f72e81c18613249'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:47.853003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b12a960c8f4b40429f72e81c18613249'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:47.853816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b12a960c8f4b40429f72e81c18613249'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:47.864763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b12a960c8f4b40429f72e81c18613249'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:47.865376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b12a960c8f4b40429f72e81c18613249'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:47.881923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:31:47.892745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 747/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:31:47 2022] DELETE /identity/v3/users/b12a960c8f4b40429f72e81c18613249 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:31:47.897615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:47.897908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:47.898212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:47.916518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:31:47.917770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:47.984324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 761/1508] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:31:47.994445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:47.996151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:48.059056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a3e1e-788e-4376-832d-3d3e9e6e4af9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:48.064011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:48.064713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:48.064995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:48.065272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:48.077338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:48.079235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8abc47-a812-4baf-b46e-702d775bc190 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:48.091205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 748/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:31:48.442923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:31:48.444409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:31:48.459171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3ed07-359d-4484-b49f-0cb523ad9284 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:31:48.465276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:31:48.466177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:31:48.466483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:31:48.466726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] PATH_INFO: `/v3/projects/b815d48d5118496ab4a916024949a8c7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:31:48.468045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b815d48d5118496ab4a916024949a8c7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:31:48.469468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:31:48.469468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:31:48.469468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:31:48.470973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:31:48.540898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b815d48d5118496ab4a916024949a8c7', 'request_id': 'req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:48.552597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b815d48d5118496ab4a916024949a8c7', 'request_id': 'req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:48.568028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b815d48d5118496ab4a916024949a8c7', 'request_id': 'req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:48.580297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] The token cache is being invalidate because project b815d48d5118496ab4a916024949a8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:31:48.580581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:48.581331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1493ab4c-b757-4f8d-9d46-0b72abe8bd74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:31:48.583609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 762/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:31:48 2022] DELETE /identity/v3/projects/b815d48d5118496ab4a916024949a8c7 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:31:58.085993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:31:58.577193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:29.144401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:29.145041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:29.145041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:29.146397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:33:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:29.151623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c21a5-4b9c-4d7a-8c47-bbaf58e5de43 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:29.152094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c21a5-4b9c-4d7a-8c47-bbaf58e5de43 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:29.152199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c21a5-4b9c-4d7a-8c47-bbaf58e5de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:29.171288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cf6c21a5-4b9c-4d7a-8c47-bbaf58e5de43 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:29.172515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf6c21a5-4b9c-4d7a-8c47-bbaf58e5de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:29.236646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:29.393450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:29.395454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:29.474193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f758ca7-9751-4191-97bb-5eb4a763b4f7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:29.480404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:29.481076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:29.481357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:29.481627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:29.490613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:29.492246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ea340-a10e-4221-addc-c17bf9ff5544 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:29.501867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 750/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:30.342352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce34a52-d3f8-4d55-8e31-0e973d0ca10c None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:30.342958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce34a52-d3f8-4d55-8e31-0e973d0ca10c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:30.342958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce34a52-d3f8-4d55-8e31-0e973d0ca10c None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:30.344435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:30.349879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7259ca-900d-46b8-9c63-fcf87c6b8ac4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:30.350493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7259ca-900d-46b8-9c63-fcf87c6b8ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:30.350493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7259ca-900d-46b8-9c63-fcf87c6b8ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:30.373397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0d7259ca-900d-46b8-9c63-fcf87c6b8ac4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:30.374662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0d7259ca-900d-46b8-9c63-fcf87c6b8ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:30.384369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:30.537820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce34a52-d3f8-4d55-8e31-0e973d0ca10c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:30.554366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce34a52-d3f8-4d55-8e31-0e973d0ca10c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:30.560918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:30.561601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:30.561910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:30.562214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:30.571542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:30.573150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8302e-5e4a-4fae-b5f0-1a6ee60c66e9 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:30.583670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 765/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:30.839961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2361a9-7e0c-4b46-b459-c6c32350cb16 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:30.840241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2361a9-7e0c-4b46-b459-c6c32350cb16 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:30.840475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2361a9-7e0c-4b46-b459-c6c32350cb16 None None] PATH_INFO: `/v3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:30.841873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 752/1517] 10.222.0.33 () {54 vars in 925 bytes} [Tue Jun 21 10:33:30 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:33:30.850180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2a1dd-01dd-4263-9810-b81e956c13de None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:30.850474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2a1dd-01dd-4263-9810-b81e956c13de None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:30.850748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2a1dd-01dd-4263-9810-b81e956c13de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:30.870874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8bf2a1dd-01dd-4263-9810-b81e956c13de None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:30.872187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8bf2a1dd-01dd-4263-9810-b81e956c13de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:30.943056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 766/1518] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jun 21 10:33:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:39.993732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8795f8-e96b-426a-b8fc-e802bf5aa508 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:39.994336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8795f8-e96b-426a-b8fc-e802bf5aa508 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:39.994336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8795f8-e96b-426a-b8fc-e802bf5aa508 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:39.995606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 753/1519] 10.222.0.43 () {54 vars in 960 bytes} [Tue Jun 21 10:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:33:40.001058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a2a6-3635-4393-8205-0f364d7cd259 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:40.001495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a2a6-3635-4393-8205-0f364d7cd259 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:40.001612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1a2a6-3635-4393-8205-0f364d7cd259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:40.021785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e3a1a2a6-3635-4393-8205-0f364d7cd259 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:40.023184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e3a1a2a6-3635-4393-8205-0f364d7cd259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:40.033144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 767/1520] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Jun 21 10:33:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:40.041155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8795f8-e96b-426a-b8fc-e802bf5aa508 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:40.056286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8795f8-e96b-426a-b8fc-e802bf5aa508 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:40.062587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:40.063223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:40.063486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:40.063781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:40.072364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:40.073994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a348-5939-4783-b639-5775a5aeae35 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:40.084332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 754/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:41.828110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167b61-dd4f-4f1a-bcef-b1832bceecbf None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:41.829034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167b61-dd4f-4f1a-bcef-b1832bceecbf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:41.829034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f167b61-dd4f-4f1a-bcef-b1832bceecbf None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:41.831267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:33:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:41.838952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa44af-b0dc-4c46-bfe6-c93e80e2b7c6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:41.839389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa44af-b0dc-4c46-bfe6-c93e80e2b7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:41.839489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa44af-b0dc-4c46-bfe6-c93e80e2b7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:41.864077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1cfa44af-b0dc-4c46-bfe6-c93e80e2b7c6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:41.865283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1cfa44af-b0dc-4c46-bfe6-c93e80e2b7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:41.874643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:42.036377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167b61-dd4f-4f1a-bcef-b1832bceecbf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:42.051832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f167b61-dd4f-4f1a-bcef-b1832bceecbf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:42.057712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:42.058380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:42.058669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:42.058943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:42.067948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:42.070035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec6aaf-f49a-4c83-a868-21b5ca1a6bcb service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:42.080639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 769/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:42.934261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679edc4-7b6c-4953-a83d-f2ffc397d65b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:42.935500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679edc4-7b6c-4953-a83d-f2ffc397d65b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:42.935979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e679edc4-7b6c-4953-a83d-f2ffc397d65b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:42.938316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jun 21 10:33:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:42.944834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c1f4-0611-48cb-b7b7-82f9fdab59ba None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:42.945545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c1f4-0611-48cb-b7b7-82f9fdab59ba None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:42.946106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751c1f4-0611-48cb-b7b7-82f9fdab59ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:42.975184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c751c1f4-0611-48cb-b7b7-82f9fdab59ba None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:42.976461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c751c1f4-0611-48cb-b7b7-82f9fdab59ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:42.985856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jun 21 10:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:43.148405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679edc4-7b6c-4953-a83d-f2ffc397d65b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:43.164196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e679edc4-7b6c-4953-a83d-f2ffc397d65b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:43.170402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:43.171047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:43.171325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:43.171593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:43.180739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:43.182381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877fc827-7d18-440c-b645-7b72c50962ac service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:43.192529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 757/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:47.084909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:47.085861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:47.085861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:47.088189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:33:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:47.097374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c908-972a-4d73-89bf-10173c68e7ee None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:47.098212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c908-972a-4d73-89bf-10173c68e7ee None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:47.098354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561c908-972a-4d73-89bf-10173c68e7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:47.119864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a561c908-972a-4d73-89bf-10173c68e7ee None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:47.121076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a561c908-972a-4d73-89bf-10173c68e7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:47.129975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:47.169256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:47.171326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:47.242239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096dc59-da97-4163-8b66-799f30d3314d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:47.246653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:47.247367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:47.247601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:47.247876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:47.257257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:47.258773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ebdbb5-5143-4100-9b9f-2eebc4afc439 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:47.264077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:33:47.269616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 772/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:49.351507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab02397-eeee-40b3-833d-99deb825ba63 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:49.352100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab02397-eeee-40b3-833d-99deb825ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:49.352100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab02397-eeee-40b3-833d-99deb825ba63 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:49.353999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:33:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:49.360243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d23f98-dd09-4731-a8d8-1537b1dcaa5f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:49.360856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d23f98-dd09-4731-a8d8-1537b1dcaa5f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:49.361028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d23f98-dd09-4731-a8d8-1537b1dcaa5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:49.387171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-91d23f98-dd09-4731-a8d8-1537b1dcaa5f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:49.388314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-91d23f98-dd09-4731-a8d8-1537b1dcaa5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:49.397028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:33:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:49.435841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab02397-eeee-40b3-833d-99deb825ba63 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:49.449648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab02397-eeee-40b3-833d-99deb825ba63 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:49.455526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:49.456502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:49.456844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:49.457227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:49.471118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:49.472587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc85043-921b-4506-9c59-22fabe1a02af service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:49.483186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 760/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:33:53.122729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:53.123310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:53.123310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:53.125161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:33:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:53.133146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f2b1-0e79-4d79-a0c7-d5f8fb344ec2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:53.133640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f2b1-0e79-4d79-a0c7-d5f8fb344ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:53.133640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f2b1-0e79-4d79-a0c7-d5f8fb344ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:53.152898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-46c3f2b1-0e79-4d79-a0c7-d5f8fb344ec2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:53.154121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-46c3f2b1-0e79-4d79-a0c7-d5f8fb344ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:53.163853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:33:53.486601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:53.489840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:53.556004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdffc4-8384-4c53-a89c-d16ac18e1e66 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:53.560540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:53.561193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:53.561477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:53.561757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:53.571917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:53.573369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9fc1c1-7796-468d-86ab-7912c31ef20f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:53.582948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 775/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:33:55.682296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:55.682923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:55.682923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:55.684252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jun 21 10:33:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:33:55.690628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af72b-a141-47fe-830e-a23914687445 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:55.691050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af72b-a141-47fe-830e-a23914687445 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:55.691203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1af72b-a141-47fe-830e-a23914687445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:55.718147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab1af72b-a141-47fe-830e-a23914687445 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:33:55.719370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab1af72b-a141-47fe-830e-a23914687445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:55.728897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jun 21 10:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:33:56.030453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:33:56.032446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:33:56.047244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c6af8-f03c-44c7-9b55-49c35d37e887 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:33:56.051185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:33:56.051826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:33:56.052108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:33:56.052385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:33:56.062474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:33:56.063936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f5a0c3-32a0-43a9-a9ad-0263439a4145 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:33:56.073683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 763/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:34:05.711366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=32 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:34:06.069172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=70 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:26.661450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:26.663408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:26.663408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:26.694386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:26.695987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:26.710680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 777/1540] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:26.721137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:26.722309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:26.722824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:26.756235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:26.757870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:26.770203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 764/1541] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:26.776337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:26.792746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e3aa0a-5090-4162-bd89-cceb3a1c59d2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:26.800910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:26.801648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:26.801927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:26.802223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:26.802970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:26.803273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:26.804918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:26.826211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 778/1542] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:26.834806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:26.858701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74483973-a5ed-4c27-bf5d-b5a890727317 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:26.866324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:26.867404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:26.867916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:26.868544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:26.869469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:26.875947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192401e2-4c62-452e-9c5d-2b5f1b281f2d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:26.914719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 765/1543] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:26 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:26.920482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:26.936777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a109c2c-caad-4feb-965a-6eb3c33707d4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:26.985998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7266297-adfc-4242-8007-f8bbb31a6937 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:26.986735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7266297-adfc-4242-8007-f8bbb31a6937 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:26.987246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7266297-adfc-4242-8007-f8bbb31a6937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.035827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b7266297-adfc-4242-8007-f8bbb31a6937 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.037434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b7266297-adfc-4242-8007-f8bbb31a6937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.037708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.038487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.038771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.039044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.042077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.042257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc7c87-842e-4d25-b0bf-b10b756a687b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.058269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 766/1544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:27.059988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.060524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.061036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.089461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 779/1545] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:26 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:35:27.091331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da458e9-15b2-41be-a8a6-bbd92f6bcc3d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.091624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da458e9-15b2-41be-a8a6-bbd92f6bcc3d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.091906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da458e9-15b2-41be-a8a6-bbd92f6bcc3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.098543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.100191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.125711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 767/1546] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.126970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.134441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2da458e9-15b2-41be-a8a6-bbd92f6bcc3d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.135995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2da458e9-15b2-41be-a8a6-bbd92f6bcc3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.145358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8d733-b864-424e-8939-27a689b8658c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.160789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 780/1547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.162344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.162633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.163372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.163524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.164549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.165158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.165626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.166810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.169225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a435e-c850-4379-85b2-c838f6a1fbe8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.187212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 768/1548] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:27.188545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.188836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.189117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.211127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.212744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.235163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.236397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.236678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 781/1549] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.237889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.252238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 769/1550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.253132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.255389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e76f4d-d7fe-45a5-90ef-c3cca84d2184 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.270337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d6598-65b2-47d7-882d-67e0613c6ddc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.280464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.281160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.281482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.281843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.282701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.283154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.284211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.284916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.285197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.285460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.285650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.286235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.287868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6cfe4-78df-4faf-8e4f-a8f64044c551 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.299183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 770/1551] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:27.300823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d1e6-9983-4ebf-91e9-d0fe6553c473 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.302107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 782/1552] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.302848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.304582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d1e6-9983-4ebf-91e9-d0fe6553c473 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.304880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93d1e6-9983-4ebf-91e9-d0fe6553c473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.325426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb940619-afda-458e-bfeb-392f41785d4a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.325671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8a93d1e6-9983-4ebf-91e9-d0fe6553c473 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.326738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8a93d1e6-9983-4ebf-91e9-d0fe6553c473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.330262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.330940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.331224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.331502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.332607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.332914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.334552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a098e-8659-4091-85c0-d23106921dd4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.335003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 771/1553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.336245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ecaf3-2a83-48c3-9d7d-de8078c9aad4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.336532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ecaf3-2a83-48c3-9d7d-de8078c9aad4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.336979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ecaf3-2a83-48c3-9d7d-de8078c9aad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.349053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 783/1554] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.350806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.351096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.351378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.356800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fa7ecaf3-2a83-48c3-9d7d-de8078c9aad4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.358004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fa7ecaf3-2a83-48c3-9d7d-de8078c9aad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.366073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 772/1555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.367317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.367599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.367889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.369764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.370920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.379458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 784/1556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.380258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.389183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.390474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.390618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1f7e3d-6261-45da-bf20-3e5530e7b35b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.395072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.395957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.396234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.396504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] PATH_INFO: `/v3/projects/ddd2066e6b9c4fa5bee1dd70417db2f9/users/5a6c082a2ccf4273bc98df8e0e6e99be/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.398758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 773/1557] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.402972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.413168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd2066e6b9c4fa5bee1dd70417db2f9, user_id=5a6c082a2ccf4273bc98df8e0e6e99be, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.413373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159fc8ff-1398-4d03-95d7-450ffd299d6e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.414293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:27.414293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:35:27.414293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:35:27.416406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72230-713b-4724-8c06-3396f2afbbb9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.418666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.419671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.419671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.419898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.420565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.422713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd73895-9032-4b76-897a-888f7739eb53 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.432163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 785/1558] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:27 2022] PUT /identity/v3/projects/ddd2066e6b9c4fa5bee1dd70417db2f9/users/5a6c082a2ccf4273bc98df8e0e6e99be/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:27.433446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.433728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.434000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.451737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.452949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.459495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 774/1559] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/projects => generated 355 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.460795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6b60-6c6c-46c9-aaa5-c5692ee991cb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.461084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6b60-6c6c-46c9-aaa5-c5692ee991cb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.461355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1e6b60-6c6c-46c9-aaa5-c5692ee991cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.480473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cd1e6b60-6c6c-46c9-aaa5-c5692ee991cb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.481704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cd1e6b60-6c6c-46c9-aaa5-c5692ee991cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.510818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.521239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 786/1560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.522131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.536657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979708d2-89ca-414b-b57f-47870d6f4542 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.544459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 775/1561] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.545775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.546087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.546361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.565348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.566701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.577228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 776/1562] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.578192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.589969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32518a0f-fc4d-4f88-b75d-276e5a9ab09e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.595134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.595797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.596329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.596616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.597351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.597665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.598747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:27.598747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:35:27.598747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:35:27.599654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f2c47-1f2d-42d1-a929-8ebc5fe08706 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.605990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.606704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.606986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.607254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.607945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.608969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:27.608969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:35:27.608969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:35:27.610180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.619773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 777/1563] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.619773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e52b2-db67-4176-9e62-3705da807873 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.619773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e52b2-db67-4176-9e62-3705da807873 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.619773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e52b2-db67-4176-9e62-3705da807873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.633958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cb8e52b2-db67-4176-9e62-3705da807873 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.635454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cb8e52b2-db67-4176-9e62-3705da807873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.647566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 778/1564] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.647566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12fec-485d-48bd-81d1-3b4e7801b2c3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.647854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 787/1565] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.647970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12fec-485d-48bd-81d1-3b4e7801b2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.647970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a12fec-485d-48bd-81d1-3b4e7801b2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.648190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.672616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-25a12fec-485d-48bd-81d1-3b4e7801b2c3 None None] MFA Rules not processed for user `5a6c082a2ccf4273bc98df8e0e6e99be`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.673736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-25a12fec-485d-48bd-81d1-3b4e7801b2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.683152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.714201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec3f7c-46e5-4079-9555-9b0f6acaf15e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.719549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.720357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.720643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.721180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.721878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.723869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.742045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 779/1566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.744275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.744652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 788/1567] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/users => generated 278 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.745871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.748015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.748313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.756691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9379a671-b614-4037-ae8e-29bb6047cc8d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.762329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.762999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.763286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.763565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.764303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.764613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.766457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.768326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:27.769532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:27.778823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 780/1568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:27.783212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.783772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 789/1569] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.784787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.794618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92372cb3-6ab5-40f1-9d27-459786cee8ff None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.796476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddfde77-27e5-49a9-84bd-c797cc48081c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.799468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.800138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.800415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.800696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.801297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.801438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.801711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.801992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.802377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.802865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.803741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.803873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.805708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.823914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 781/1570] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.823914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.828863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3072f6f-406f-4e9f-9bf6-9b9322279d30 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.833752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.833935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 790/1571] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.834829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.834955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.835163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.835372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.836095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.836465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.838460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.851078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 782/1572] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.851934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.863750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99639e8f-f8a2-4b4d-9b1d-076cee9cea2c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.879797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:27.900835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0255a6d0-cfd1-4a24-b4d5-d5f999e36c30 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.906442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.907127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.907413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.907712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.908409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.910395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b242b-2bf0-417f-8d4b-e34c27cb76ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.922711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.923459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.923748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.924021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.924895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.926883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.931327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 791/1573] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.932652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e718f-c753-4f90-8bca-197da10c062d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.932947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e718f-c753-4f90-8bca-197da10c062d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.933215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47e718f-c753-4f90-8bca-197da10c062d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.934522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 792/1574] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jun 21 10:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:27.939003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e718f-c753-4f90-8bca-197da10c062d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.943626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 783/1575] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:27.943626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.952190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b779e-0573-438c-a0f9-753fdef0f2fc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.952453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47e718f-c753-4f90-8bca-197da10c062d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.956772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.957798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.957927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.958206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.958378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.958593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.958874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.959068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.959273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.960011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:27.960328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.961003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.961947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:27.975204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 793/1576] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:27.975852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.988545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc778bc-5879-49c8-8114-cd967a44f3bc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:27.995932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 784/1577] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:27.996129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:27.996258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:27.996354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:27.996354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:27.996354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:27.996354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:27.997853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.030469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 794/1578] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.030469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.052788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.065528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9350e-1982-4864-8bb6-472075d9ee2b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.092047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8acac-1d70-4351-8512-24c978e6c696 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.096859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.097536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.097824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.098128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.098834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.100781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.128058 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.128432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 795/1579] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.128844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.129135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.129241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.129425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.130127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.131199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:28.131199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:35:28.131199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:35:28.132694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab97ee7-5e9a-45ef-a570-7f24f79c5337 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.157053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 785/1580] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:27 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.157053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.157053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.157053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.173676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:28.174839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:28.200197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ae6a4-41a0-4aa4-80ba-863f592c9b25 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.205601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.206314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.206598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.206868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.207960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.209592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.220269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 796/1581] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.221124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.231786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5838d-91bc-472b-b3a3-2ef5cb165fd6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.236545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.237231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.237519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.237847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.238632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.240245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.250627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 797/1582] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.251417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.257994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 786/1583] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:28.257994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.262635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.267012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97cf589-f034-40a0-8c5e-8500f754bd73 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.273197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ac6e2-5e90-492a-96ee-d34fbf13e054 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.275335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.276213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.276480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.276756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.277463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.279211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.279436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.279894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.280170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.280439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.281132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.283099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.306580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 787/1584] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/users => generated 283 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.307412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.311376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 798/1585] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.311376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.320933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e85035-2d9a-46a1-87b8-9b2a88e16a19 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.374407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04bea0-117d-40d4-805c-1d59bd4a1f2d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.379075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.379479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.379746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.380022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.380140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.380303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.380481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.380679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.380985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.381352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.382941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.383306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.392967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.409497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 788/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/users => generated 303 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.410348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.414916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 799/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/users => generated 290 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.414916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.420197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac19d9e-ad8f-4d27-9370-919e354a4646 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.425237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.425692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bdd1ac-9564-4778-a34b-83cccdb206de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.425834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.426088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.426387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.427094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.428700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.430382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.431246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.431521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.431814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.432531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.434165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.439757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 789/1588] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.440328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.444792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 800/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.445662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.453234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0f9041-cf20-47d7-87b2-70953ec27dbb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.458387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.459276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.459553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.459826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] PATH_INFO: `/v3/projects/a2ede8feca3b403e99eb3cdeb33c74bf/users/6e2dad7540e14d8b9d3faa339d6cca26/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.476271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2ede8feca3b403e99eb3cdeb33c74bf, user_id=6e2dad7540e14d8b9d3faa339d6cca26, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.479290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.494470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 790/1590] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:28 2022] PUT /identity/v3/projects/a2ede8feca3b403e99eb3cdeb33c74bf/users/6e2dad7540e14d8b9d3faa339d6cca26/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:28.504253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.528765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba126d8-5015-439e-ab03-1a7093ebf489 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.557131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5fb4-1ae8-442e-bbe2-1921866cc804 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.562461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.563241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.563587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.563850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.564647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.566494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.577351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 791/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.578227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.586255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.589315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640d54d6-7fc6-48c8-96cb-a3224f091a72 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.594409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.595125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.595440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.595757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.596472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.598487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.600694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.601356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.601637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.601930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.618770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 792/1592] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:28.619613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.629470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4278160d-b2d8-4bbf-8eb9-5a1c980b8e6b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.634984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.635660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.635951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.636313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.636965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.638649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.652859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 793/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.652859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.658727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.660478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.662816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290010a0-3e00-47a5-b046-7a61172800f5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.668605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.669272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.669855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.670315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.670440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 801/1594] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:28.670903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.671001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.672552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.681283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2a93a-07cb-4b1a-81c0-e9fe4e1fd578 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.686488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 794/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.686488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.688984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.689655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.689942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.690310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.691057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.692696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388d64a-e5a8-4ada-a367-e2fc7cf5666c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.697275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e18ef-d6f7-40d7-b4fd-f16a2d000a73 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.702444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.703337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.703618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.708556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 802/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.708797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] PATH_INFO: `/v3/projects/dadbbbf08f7b44ce8594f389765f35b2/users/f58d6e222d654e66b38fcefeff65fe80/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.709211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.709211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.709211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.724742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dadbbbf08f7b44ce8594f389765f35b2, user_id=f58d6e222d654e66b38fcefeff65fe80, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.728720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.735457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] MFA Rules not processed for user `6e2dad7540e14d8b9d3faa339d6cca26`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:28.736810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:28.747757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 795/1597] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:28 2022] PUT /identity/v3/projects/dadbbbf08f7b44ce8594f389765f35b2/users/f58d6e222d654e66b38fcefeff65fe80/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:28.747757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.800668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.810579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 803/1598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:28.811651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.814961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78c0a3-0784-414c-a1f2-d2976c43a498 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.820080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.820758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.821086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.821359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.822182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.822689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5a619-3e2f-47ac-827f-bc5a2f8b0137 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.823813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.827459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.828164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.828446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.828723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.829662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.831089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.835374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 796/1599] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.836097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.845240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 804/1600] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.845240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.849617 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c8b3-292e-4878-92d8-c407b68c5804 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.854878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.855618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.855966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.856194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c7bec1-58fc-48c1-b3a2-5371d77e3386 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.856356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.857156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.858948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.861059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.861823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.862249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.862602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.863396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.865194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d072b1-63f2-4abb-9525-3f614687bda5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.870606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 797/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.871376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.882183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 805/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:28.882183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.882183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.882183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.885908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631095-4688-43c0-b99a-d701df438f57 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.890631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.891636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.892019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.892331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] PATH_INFO: `/v3/projects/3ddb0def61dd452db3588952af149fb7/users/9bbb5d4487874bdd9f82e28651a418f9/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.900870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:28.902193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:28.908939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddb0def61dd452db3588952af149fb7, user_id=9bbb5d4487874bdd9f82e28651a418f9, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.910821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 806/1603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:28.911611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.911725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.922963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a39d12-160e-4f1e-ba2f-500a18241cfa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:28.926800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 798/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:28 2022] PUT /identity/v3/projects/3ddb0def61dd452db3588952af149fb7/users/9bbb5d4487874bdd9f82e28651a418f9/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:28.927431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:28.969005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:28.983607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:28.984513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:28.984893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:28.986281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:28.986281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:28.988246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:28.998397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31740599-cff7-4d69-8687-66477a2e64f1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.003949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.004863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.005182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.005453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] PATH_INFO: `/v3/projects/576718e09ca44e47973f21fc2fe78ef3/users/d7b074c550164bfd87c22800ba2a628a/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.020891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 807/1605] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:28 2022] POST /identity/v3/projects => generated 355 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:29.022154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] RBAC: Authorizing `identity:create_grant(project_id=576718e09ca44e47973f21fc2fe78ef3, user_id=d7b074c550164bfd87c22800ba2a628a, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.022317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.024944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.038731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 799/1606] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:28 2022] PUT /identity/v3/projects/576718e09ca44e47973f21fc2fe78ef3/users/d7b074c550164bfd87c22800ba2a628a/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:29.039538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.088146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09977362-c2f6-4954-985b-23cf26463d08 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.104204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c41a90-15bd-4970-8dca-f326fd6aaaae admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.109547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.110593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.110883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.111161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] PATH_INFO: `/v3/projects/b65df85b375a4f4896a9dcc535bf7f68/users/7ca3c15437204302a66f0bbaaced6b02/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.127386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65df85b375a4f4896a9dcc535bf7f68, user_id=7ca3c15437204302a66f0bbaaced6b02, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.130174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.145367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 800/1607] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:29 2022] PUT /identity/v3/projects/b65df85b375a4f4896a9dcc535bf7f68/users/7ca3c15437204302a66f0bbaaced6b02/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:29.146362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.148048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.148750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.149037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.149370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.150133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.151753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7d4fe-aba6-48d3-a222-519144be4081 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.165170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 808/1608] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:29.166238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e770bbf-c5b8-45fc-9ba0-ca40851637ec None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.166531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e770bbf-c5b8-45fc-9ba0-ca40851637ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.167222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e770bbf-c5b8-45fc-9ba0-ca40851637ec None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.168205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 809/1609] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jun 21 10:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:29.168907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e770bbf-c5b8-45fc-9ba0-ca40851637ec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.174595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:29.222804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc6a57-d056-4239-bf8a-cfd134e0fc2e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.226989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e770bbf-c5b8-45fc-9ba0-ca40851637ec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.227886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.228804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.229084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.229350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] PATH_INFO: `/v3/projects/b76f6f1219f94a24b5015fb819a67ed6/users/5a3a6c87dbcb41eba4597f8a16651ecc/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.230994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.231642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.231922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.232196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.241635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.243196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e9cf1a-401a-4137-8e2a-4834da777a94 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.244428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76f6f1219f94a24b5015fb819a67ed6, user_id=5a3a6c87dbcb41eba4597f8a16651ecc, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.247164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.253013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 810/1610] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:29.254648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f747-020a-4dc2-8a5e-a2b16308572d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.254934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f747-020a-4dc2-8a5e-a2b16308572d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.255255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16f747-020a-4dc2-8a5e-a2b16308572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.272837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 801/1611] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:29 2022] PUT /identity/v3/projects/b76f6f1219f94a24b5015fb819a67ed6/users/5a3a6c87dbcb41eba4597f8a16651ecc/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:29.273987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.278560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ed16f747-020a-4dc2-8a5e-a2b16308572d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.280177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ed16f747-020a-4dc2-8a5e-a2b16308572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.294810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:29.353971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e1dda-b6f1-40ab-8d40-c404b8084c79 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.354236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 811/1612] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.354236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.354236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.354236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.356394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.357288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.357679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.357991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.358933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.361094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a71f88-b0de-4352-abf7-95c263c66de6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.382692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 802/1613] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:29.384186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a572ab-c6a1-4901-9790-4098321b9061 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.384535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a572ab-c6a1-4901-9790-4098321b9061 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.384881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a572ab-c6a1-4901-9790-4098321b9061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.386822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] MFA Rules not processed for user `d7b074c550164bfd87c22800ba2a628a`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.388101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.416139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-90a572ab-c6a1-4901-9790-4098321b9061 None None] MFA Rules not processed for user `7ca3c15437204302a66f0bbaaced6b02`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.418348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-90a572ab-c6a1-4901-9790-4098321b9061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.485289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 812/1614] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.485289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.497054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5999a7-4afa-4e3f-b55b-b70c73b5657b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.502468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.503720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.504005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.504281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] PATH_INFO: `/v3/projects/b681cec57bfb45fba7a03691e46242ac/users/3283d795d3b54d03a277b73eb6cd5aa5/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.507180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 803/1615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.512040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.512391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.512778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.521699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b681cec57bfb45fba7a03691e46242ac, user_id=3283d795d3b54d03a277b73eb6cd5aa5, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.524439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4355cd15-d0af-48ea-ba1d-3f89228babd2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.532167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.533489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.541170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 813/1616] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:29 2022] PUT /identity/v3/projects/b681cec57bfb45fba7a03691e46242ac/users/3283d795d3b54d03a277b73eb6cd5aa5/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:29.542951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.543364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.543633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.565716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.567751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:29.568760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.647293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 804/1617] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.648324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.649839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.678674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 814/1618] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.679768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.693947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621526a-1964-4f6c-ae75-906fe4a72834 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.701173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.701906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.702224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.702658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.704610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.706331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.722383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 815/1619] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:29.722383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.732948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6f977-75f5-453f-9843-16718aaada50 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.734995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899566-9d79-4a23-867a-df74971b78c7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.738254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.738854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.739135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.739528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.739633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.740515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.740662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.740845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.741253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.742552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ab6c7-4458-48ae-b42b-9b6a1b6f0564 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.753268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.754896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.755404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:29.767188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 805/1620] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:29.768397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.777406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 816/1621] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:29.779125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.779516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.779892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.780282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e338e9-9e28-42cb-a512-50e4c5754849 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.813161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] MFA Rules not processed for user `3283d795d3b54d03a277b73eb6cd5aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:29.814776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:29.858929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.859264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.859436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.859717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:29.860421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:29.862397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:29.897591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 806/1622] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/projects => generated 403 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:29.897591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.910618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 817/1623] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:29.911522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:29.959644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:29.986926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5f3956-8b49-45c7-a2fa-018c4b894c85 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.988672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676eff4b-ef23-412f-a05e-0d648e5341d6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:29.992701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:29.993358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:29.993858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:29.994248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.073997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.074769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.075060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.075341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.119576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.124906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.145616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 807/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:30.146558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.240883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:30.285202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.287049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.309411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 818/1625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:30.310365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.320998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b24fd-bf54-4a33-85e7-c4a0f07ee235 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.326788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caa471e-c8e0-4f21-a14b-58f60e46cd7e service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.327047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.327746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.328121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.328400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.329110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.331496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.337506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.338647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.338927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.339196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] PATH_INFO: `/v3/projects/03defe771c234365803c14bc9d57d0e4/users/ce2bd4226d6141be9a6e2b54d82ab386/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.374590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03defe771c234365803c14bc9d57d0e4, user_id=ce2bd4226d6141be9a6e2b54d82ab386, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.375483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 819/1626] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:30 2022] POST /identity/v3/users => generated 289 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:30.376196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.380508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.402718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b5de7-fe8e-4b49-bd14-1d2fa0a87886 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.410532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 808/1627] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:30 2022] PUT /identity/v3/projects/03defe771c234365803c14bc9d57d0e4/users/ce2bd4226d6141be9a6e2b54d82ab386/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:30.411291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.555030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.556061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.556329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.556801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.557892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.563154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498c25c-4772-40e4-9680-667a891a6437 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.564827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.573644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.574397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.574846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.575131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.575841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.578720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.592949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:30.614784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 820/1628] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:30 2022] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:30.619002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.625994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 809/1629] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:30 2022] POST /identity/v3/projects => generated 373 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:30.627196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.652460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363cd1bd-e6a4-41d3-9a09-f855dc94e7d6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.786084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ff20b-a4b0-4463-813a-2735fa860d66 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.792498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.793201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.793486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.793768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.794737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.796947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.810309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 810/1630] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:30.811499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.826124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a087e-3233-471d-b502-0444152ca59c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.833110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.833928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.834635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.834635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.835297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.835743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.837022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.838525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.838838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.841593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.842539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.848127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.854658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 811/1631] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:30.855630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.868200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70b3d4c-9cf3-40ac-a618-9cabfd0246a7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.875918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.877047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.877391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.877899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.878727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.880950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.895906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 821/1632] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:30 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:30.896904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.910907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 812/1633] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:30 2022] POST /identity/v3/users => generated 293 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:30.911914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:30.926502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e288dec-8faf-472b-b19e-ed90d314b8e2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.930012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ee60-0941-4e2f-b5a9-5a4bdb951999 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:30.934083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.935224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.935790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.936344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] PATH_INFO: `/v3/projects/a104608e54d64e36a6a531539aa41e11/users/80708e65d6c54b5387a6de283f4cc2c3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.941546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:30.944754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:30.945049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:30.945330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] PATH_INFO: `/v3/projects/03defe771c234365803c14bc9d57d0e4/users/ce2bd4226d6141be9a6e2b54d82ab386/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:30.952385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03defe771c234365803c14bc9d57d0e4, user_id=ce2bd4226d6141be9a6e2b54d82ab386, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.958561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a104608e54d64e36a6a531539aa41e11, user_id=80708e65d6c54b5387a6de283f4cc2c3, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:30.965213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:30.966846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.004199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 813/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:30 2022] PUT /identity/v3/projects/a104608e54d64e36a6a531539aa41e11/users/80708e65d6c54b5387a6de283f4cc2c3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:31.011984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.013061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 822/1635] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:30 2022] PUT /identity/v3/projects/03defe771c234365803c14bc9d57d0e4/users/ce2bd4226d6141be9a6e2b54d82ab386/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:31.014085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.143278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:31.186154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9656f4-8b7d-4eba-9926-46ec7a44e214 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.201681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5330dd-5a05-4964-94a4-f13ae35c45f6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.204739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.210348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.215240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.216047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] PATH_INFO: `/v3/projects/6db5a615db5c4e698c903e128c0c294b/users/b40df390292e489d82d56aae17b70fa9/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.222282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.223911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.225390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.225832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.226766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.231076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.265814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db5a615db5c4e698c903e128c0c294b, user_id=b40df390292e489d82d56aae17b70fa9, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.281971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 823/1636] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:31.285250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.292743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645d8459-c8bd-4c49-8cb7-5901414e96c5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.316841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60c156-7174-4728-a5f3-5af4334ed04e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.350121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 814/1637] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:31 2022] PUT /identity/v3/projects/6db5a615db5c4e698c903e128c0c294b/users/b40df390292e489d82d56aae17b70fa9/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:31.352556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.352981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.354158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.355176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.356515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.358610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.358952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.360181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.365679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.419357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 824/1638] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:31.422979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.444963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] MFA Rules not processed for user `ce2bd4226d6141be9a6e2b54d82ab386`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:31.447266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9286c26-34f7-4ac5-910e-493fbe5e9a56 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.449045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:31.465827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:31.600075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.601142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.601950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.602546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] PATH_INFO: `/v3/projects/408d67e023fd4076bc343ab364ad389d/users/4aed9c3294594acba5e25d7f587ff1c1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.662893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] RBAC: Authorizing `identity:create_grant(project_id=408d67e023fd4076bc343ab364ad389d, user_id=4aed9c3294594acba5e25d7f587ff1c1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.663762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 815/1639] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:31 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:31.664512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.668187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.691947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f8dd1-4b25-44ec-9b71-341c98f4c95a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.703841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.704621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.704907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.705186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.705977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.714092 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.719974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 825/1640] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:31 2022] PUT /identity/v3/projects/408d67e023fd4076bc343ab364ad389d/users/4aed9c3294594acba5e25d7f587ff1c1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:31.723540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.738285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 816/1641] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:31.741865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:31.900351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6754f90c-8470-44ee-a063-fc5415f6b80e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.904746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d0f6c0-8bec-4c09-8dab-91fdeacc732c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:31.914834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:31.915981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:31.916310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:31.916592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] PATH_INFO: `/v3/projects/a104608e54d64e36a6a531539aa41e11/users/80708e65d6c54b5387a6de283f4cc2c3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:31.925862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a104608e54d64e36a6a531539aa41e11, user_id=80708e65d6c54b5387a6de283f4cc2c3, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:31.937109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:31.983653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 826/1642] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:31 2022] PUT /identity/v3/projects/a104608e54d64e36a6a531539aa41e11/users/80708e65d6c54b5387a6de283f4cc2c3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:31.984034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:32.077642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.077642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.077642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.077642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.144677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.180992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbcd13-094f-4d1f-814f-81a74c035c90 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:32.197394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.198323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.198608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.198884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.199634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:32.201276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:32.240480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 827/1643] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:31 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:32.248187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:32.258558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.265155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:32.271288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c474c1d-edcc-4e15-bdba-ec04786afb81 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:32.284180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aade7b-fc73-4955-9e9c-a4c94defc9cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:32.293127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.300043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.305324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.305606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] PATH_INFO: `/v3/projects/6db5a615db5c4e698c903e128c0c294b/users/b40df390292e489d82d56aae17b70fa9/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.309612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 817/1644] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:31 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:32.309612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce031-66c0-4d7c-8935-3a5b7e7d74a4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.318780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce031-66c0-4d7c-8935-3a5b7e7d74a4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.319039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ce031-66c0-4d7c-8935-3a5b7e7d74a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.323224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6db5a615db5c4e698c903e128c0c294b, user_id=b40df390292e489d82d56aae17b70fa9, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:32.327573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c0688f-76c4-4b22-8d5f-4810e9a1d6e7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:32.366389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 828/1645] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:32 2022] PUT /identity/v3/projects/6db5a615db5c4e698c903e128c0c294b/users/b40df390292e489d82d56aae17b70fa9/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:32.368179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be46e8-7cee-4a58-8168-38b067df9f77 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.368747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be46e8-7cee-4a58-8168-38b067df9f77 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.369456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be46e8-7cee-4a58-8168-38b067df9f77 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.371431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 829/1646] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jun 21 10:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:32.372842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be46e8-7cee-4a58-8168-38b067df9f77 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:32.406218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1c6ce031-66c0-4d7c-8935-3a5b7e7d74a4 None None] MFA Rules not processed for user `80708e65d6c54b5387a6de283f4cc2c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:32.407512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1c6ce031-66c0-4d7c-8935-3a5b7e7d74a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:32.507024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be46e8-7cee-4a58-8168-38b067df9f77 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:32.516803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.518827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.519806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.521377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] PATH_INFO: `/v3/projects/408d67e023fd4076bc343ab364ad389d/users/4aed9c3294594acba5e25d7f587ff1c1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.526477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] RBAC: Authorizing `identity:create_grant(project_id=408d67e023fd4076bc343ab364ad389d, user_id=4aed9c3294594acba5e25d7f587ff1c1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:32.530575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95cc3f1-10ce-44e4-bc7c-625b56fb7ada admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:32.547753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 818/1647] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:32.549236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.549743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.550378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.557925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 830/1648] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:32 2022] PUT /identity/v3/projects/408d67e023fd4076bc343ab364ad389d/users/4aed9c3294594acba5e25d7f587ff1c1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:32.559450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.561671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.561671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.615039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:32.619430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:32.622991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] MFA Rules not processed for user `b40df390292e489d82d56aae17b70fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:32.624220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:32.792990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 831/1649] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jun 21 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:32.793891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:32.803685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 819/1650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:32.808979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:32.912153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bcf3e-cc0a-43bb-8b0b-8874e9233bfd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:32.919218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.919794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.920077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.920950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.930990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45ba0ae-258a-4c5c-9f34-edf11fab53a4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:32.937710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:32.941111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:32.941574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:32.942946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:32.951518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:32.973046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:33.130005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:33.132003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dee28d0-28e4-4bd5-b843-cc7c485f15a3 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:33.146009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 820/1651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:33.147578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:33.148163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.148601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.149443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.149613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c8026-3e60-4aca-b5cd-1890bd31db8e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:33.201553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 832/1652] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:32 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:33.203840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c4b6-a903-4aa2-9b65-6d64d8744aa9 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.205849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] MFA Rules not processed for user `4aed9c3294594acba5e25d7f587ff1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:33.206302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c4b6-a903-4aa2-9b65-6d64d8744aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.206692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec9c4b6-a903-4aa2-9b65-6d64d8744aa9 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.207490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:33.216980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 833/1653] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jun 21 10:35:33 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:33.224735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.225447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.225847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.302021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:33.303995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:33.361502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 821/1654] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:33.361502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:33.363359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 834/1655] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:35:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:33.375166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ed56-b491-4db3-948a-cbe8954a362e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:33.379787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:33.380463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.380747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.381027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.393969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:33.395898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:33.409602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 822/1656] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:33.557675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:33.568955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:33.578647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd115f4-e993-41cf-8d54-53b4d0ac80c1 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:33.582853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:33.583715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.584004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.584284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.585348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d680ed-590a-4fd1-9072-1a1ecdb2c825 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:33.596672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:33.597730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:33.598195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:33.598795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:33.599190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:33.599563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:33.617534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 823/1657] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:33.621826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:33.623652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:33.656686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 835/1658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:34.020581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:34.031069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df94ef-7c90-4b67-8ca3-279539d5d7c4 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:34.049947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:34.050680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:34.050965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:34.052426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:34.139654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:34.291349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:34.292860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5f567f-df01-4bea-be43-4e4f730317b8 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:34.315344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 824/1659] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:34.339723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aae0aa-1d4c-4876-a21e-916b193d5f7e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:34.352994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:34.355676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:34.355968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:34.357584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] PATH_INFO: `/v3/users/7ca3c15437204302a66f0bbaaced6b02` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:34.362203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca3c15437204302a66f0bbaaced6b02)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:34.365660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: WARNING py.warnings [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:34.365660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: warnings.warn(msg) Jun 21 10:35:34.365660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: Jun 21 10:35:34.368758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:34.597144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca3c15437204302a66f0bbaaced6b02'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:34.618685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca3c15437204302a66f0bbaaced6b02'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:34.706424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca3c15437204302a66f0bbaaced6b02'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:34.707695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca3c15437204302a66f0bbaaced6b02'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:34.735900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca3c15437204302a66f0bbaaced6b02'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:34.760172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 836/1660] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:34 2022] DELETE /identity/v3/users/7ca3c15437204302a66f0bbaaced6b02 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:34.761634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238624b7-a952-4365-bdf0-57442a7325be None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:34.762131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238624b7-a952-4365-bdf0-57442a7325be None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:34.762610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238624b7-a952-4365-bdf0-57442a7325be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:34.830425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-238624b7-a952-4365-bdf0-57442a7325be None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:34.831698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-238624b7-a952-4365-bdf0-57442a7325be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:34.852338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:34.976173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 825/1661] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:35.199164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:35.201455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:35.227808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:35.319607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238624b7-a952-4365-bdf0-57442a7325be None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:35.321146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-238624b7-a952-4365-bdf0-57442a7325be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:35.343463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238624b7-a952-4365-bdf0-57442a7325be None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:35.358167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:35.359087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:35.359373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:35.359652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] PATH_INFO: `/v3/users/3283d795d3b54d03a277b73eb6cd5aa5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:35.362521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3283d795d3b54d03a277b73eb6cd5aa5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:35.364563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:35.368052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b874af4-a59b-4aae-a1af-b482072f1bbf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:35.386901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:35.387613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:35.387901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:35.388193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:35.415441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:35.419917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f2894f-fde8-4876-b110-ea2a35f7a050 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:35.449551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 837/1662] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:35.459224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3283d795d3b54d03a277b73eb6cd5aa5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:35.485078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3283d795d3b54d03a277b73eb6cd5aa5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:35.486879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3283d795d3b54d03a277b73eb6cd5aa5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:35.505474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3283d795d3b54d03a277b73eb6cd5aa5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:35.507332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3283d795d3b54d03a277b73eb6cd5aa5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:35.548166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 826/1663] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:35 2022] DELETE /identity/v3/users/3283d795d3b54d03a277b73eb6cd5aa5 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:35.551997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:35.552629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:35.553026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:35.571921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:35.573756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:35.663376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 838/1664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:35.687228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:35.688791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:35.828613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b654665-d13f-4269-be88-5d38fd372c9d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:35.839520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:35.840295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:35.840574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:35.840857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:35.887200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:35.888884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7696f801-6a61-4e2d-bef2-83e9b1d35158 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:35.915744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 827/1665] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:36.823686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:36.826105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:36.854097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4dfcc-02d8-4dce-b080-dec275d8b88b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:36.885135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:36.889327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:36.892149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:36.893549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] PATH_INFO: `/v3/users/5a6c082a2ccf4273bc98df8e0e6e99be` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:36.897145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a6c082a2ccf4273bc98df8e0e6e99be)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:36.903610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:37.066169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a6c082a2ccf4273bc98df8e0e6e99be'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.087355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a6c082a2ccf4273bc98df8e0e6e99be'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.117310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a6c082a2ccf4273bc98df8e0e6e99be'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.120918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a6c082a2ccf4273bc98df8e0e6e99be'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.151102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a6c082a2ccf4273bc98df8e0e6e99be'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.164511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 839/1666] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:36 2022] DELETE /identity/v3/users/5a6c082a2ccf4273bc98df8e0e6e99be => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:37.169765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:37.170340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:37.170340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:37.216268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:37.217539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:37.291558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:37.376070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 828/1667] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:37.395687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:37.397618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:37.471617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:37.520910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:37.522624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:37.558630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc0832-9560-45a1-af7a-faea9a352acc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:37.574102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a64f80-316b-41bd-a10f-2b64bfcf7205 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:37.575094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:37.576017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:37.576307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:37.576663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] PATH_INFO: `/v3/projects/b65df85b375a4f4896a9dcc535bf7f68` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:37.578906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:37.580157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:37.580691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:37.581118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:37.585443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65df85b375a4f4896a9dcc535bf7f68)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:37.589432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: WARNING py.warnings [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 21 10:35:37.589432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: warnings.warn(msg) Jun 21 10:35:37.589432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: Jun 21 10:35:37.590897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:37.604436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:37.612618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:37.631766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 840/1668] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:37.740751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65df85b375a4f4896a9dcc535bf7f68', 'request_id': 'req-e8abb0d1-366a-40ca-8351-0a52b1392a8e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.764786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65df85b375a4f4896a9dcc535bf7f68', 'request_id': 'req-e8abb0d1-366a-40ca-8351-0a52b1392a8e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.793319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65df85b375a4f4896a9dcc535bf7f68', 'request_id': 'req-e8abb0d1-366a-40ca-8351-0a52b1392a8e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.821637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] The token cache is being invalidate because project b65df85b375a4f4896a9dcc535bf7f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:37.821637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.822426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e8abb0d1-366a-40ca-8351-0a52b1392a8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:37.825141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 829/1669] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:37 2022] DELETE /identity/v3/projects/b65df85b375a4f4896a9dcc535bf7f68 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:37.829393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:37.848695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f60187-b256-4d2e-8796-98ff859bd33c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:37.985490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:37.987312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:37.987764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:37.991273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] PATH_INFO: `/v3/users/80708e65d6c54b5387a6de283f4cc2c3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:37.993331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80708e65d6c54b5387a6de283f4cc2c3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:37.995604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:38.097842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80708e65d6c54b5387a6de283f4cc2c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:38.128883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80708e65d6c54b5387a6de283f4cc2c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:38.145024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80708e65d6c54b5387a6de283f4cc2c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:38.145843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80708e65d6c54b5387a6de283f4cc2c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:38.158715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80708e65d6c54b5387a6de283f4cc2c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:38.174212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 841/1670] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:37 2022] DELETE /identity/v3/users/80708e65d6c54b5387a6de283f4cc2c3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:38.591222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:38.591780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:38.591780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:38.674466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] MFA Rules not processed for user `f58d6e222d654e66b38fcefeff65fe80`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:38.678679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:38.773037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:38.774982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:38.939823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 830/1671] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:38.940740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:38.942346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:38.945571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:39.004358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c30d61-3447-460e-9d0d-6ba273f4b280 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:39.031467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:39.032733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:39.033198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:39.033663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] PATH_INFO: `/v3/projects/b681cec57bfb45fba7a03691e46242ac` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:39.035628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b681cec57bfb45fba7a03691e46242ac)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:39.043439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:39.110811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:39.168979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af8fae-094f-4817-add6-b49003091a05 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:39.175507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:39.176580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:39.176925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:39.177180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] PATH_INFO: `/v3/projects/ddd2066e6b9c4fa5bee1dd70417db2f9` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:39.178563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd2066e6b9c4fa5bee1dd70417db2f9)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:39.181124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:39.241889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b681cec57bfb45fba7a03691e46242ac', 'request_id': 'req-4601ebc3-3ed1-4cf7-b980-90bff4571877'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.277367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b681cec57bfb45fba7a03691e46242ac', 'request_id': 'req-4601ebc3-3ed1-4cf7-b980-90bff4571877'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.287556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b681cec57bfb45fba7a03691e46242ac', 'request_id': 'req-4601ebc3-3ed1-4cf7-b980-90bff4571877'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.295603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd2066e6b9c4fa5bee1dd70417db2f9', 'request_id': 'req-50144324-7bc8-4e68-a50b-9efd05eb778d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.306344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd2066e6b9c4fa5bee1dd70417db2f9', 'request_id': 'req-50144324-7bc8-4e68-a50b-9efd05eb778d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.317245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd2066e6b9c4fa5bee1dd70417db2f9', 'request_id': 'req-50144324-7bc8-4e68-a50b-9efd05eb778d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.355608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] The token cache is being invalidate because project b681cec57bfb45fba7a03691e46242ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:39.357479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.359765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.366008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 842/1672] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:38 2022] DELETE /identity/v3/projects/b681cec57bfb45fba7a03691e46242ac => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:39.371195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:39.374001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:39.375526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] The token cache is being invalidate because project ddd2066e6b9c4fa5bee1dd70417db2f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:39.375660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.378270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.393610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 831/1673] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:38 2022] DELETE /identity/v3/projects/ddd2066e6b9c4fa5bee1dd70417db2f9 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:39.397087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:39.398198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:39.613367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601ebc3-3ed1-4cf7-b980-90bff4571877 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:39.623381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144324-7bc8-4e68-a50b-9efd05eb778d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:39.637918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:39.641945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:39.642471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:39.643012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] PATH_INFO: `/v3/users/4aed9c3294594acba5e25d7f587ff1c1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:39.648346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4aed9c3294594acba5e25d7f587ff1c1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:39.657239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:39.782832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4aed9c3294594acba5e25d7f587ff1c1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.784911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:39.785604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:39.785888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:39.786202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:39.796045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:39.803557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4aed9c3294594acba5e25d7f587ff1c1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.806425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4aed9c3294594acba5e25d7f587ff1c1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.833237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:39.842971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4aed9c3294594acba5e25d7f587ff1c1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.843610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fbe5fbbb-0e7e-4b5d-9a9b-959a740bd83a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4aed9c3294594acba5e25d7f587ff1c1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:39.867342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:39.892996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 832/1674] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:39 2022] DELETE /identity/v3/users/4aed9c3294594acba5e25d7f587ff1c1 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:39.894405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653907-5d6a-412b-b5ef-1d8e0cee9a53 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:39.894696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653907-5d6a-412b-b5ef-1d8e0cee9a53 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:39.894975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb653907-5d6a-412b-b5ef-1d8e0cee9a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:39.952114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cb653907-5d6a-412b-b5ef-1d8e0cee9a53 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:39.953614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cb653907-5d6a-412b-b5ef-1d8e0cee9a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:39.990143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:39.991596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.033213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 843/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:40.121428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.123030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:40.126630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 833/1676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:40.136412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.136695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.136972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.151792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51670299-97e4-4ce0-976f-22cb4328240c service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:40.175904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:40.176799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.177071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.177334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] PATH_INFO: `/v3/projects/a104608e54d64e36a6a531539aa41e11` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.180715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a104608e54d64e36a6a531539aa41e11)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:40.182718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.195287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:40.196568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:40.239551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 834/1677] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:40.247483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.279375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1af91-2ef4-423d-96be-53d8ecf6e1e1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:40.296739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:40.297512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.297790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.298122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.298972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:40.299277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:40.304119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.331758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 835/1678] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:35:40.339578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.365055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a104608e54d64e36a6a531539aa41e11', 'request_id': 'req-c94cf2e3-a886-41dd-99d4-a39d0317061d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:40.366573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c21448-8ebd-40b8-851b-e160eba1dcff admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:40.391997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a104608e54d64e36a6a531539aa41e11', 'request_id': 'req-c94cf2e3-a886-41dd-99d4-a39d0317061d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:40.407875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a104608e54d64e36a6a531539aa41e11', 'request_id': 'req-c94cf2e3-a886-41dd-99d4-a39d0317061d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:40.442440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] The token cache is being invalidate because project a104608e54d64e36a6a531539aa41e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:40.442730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:40.449785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c94cf2e3-a886-41dd-99d4-a39d0317061d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:40.455482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 844/1679] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:40 2022] DELETE /identity/v3/projects/a104608e54d64e36a6a531539aa41e11 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:40.460792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb0fe-27e8-47b9-b771-9b1959135583 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.461016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb0fe-27e8-47b9-b771-9b1959135583 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.461293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfb0fe-27e8-47b9-b771-9b1959135583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.524129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e2dfb0fe-27e8-47b9-b771-9b1959135583 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:40.535090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e2dfb0fe-27e8-47b9-b771-9b1959135583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:40.562736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:40.565286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.565458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.565737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.571990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:40.575529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.646660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 836/1680] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:40 2022] POST /identity/v3/projects => generated 365 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:40.648344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.652944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:40.699433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 845/1681] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:40.715717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.716079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.716355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.748054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:40.749312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:40.857318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:40.866189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd3034-aefe-4b2c-819f-20a8c98a5b86 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:40.875510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:40.877387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:40.878128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.878411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.878749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.879499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:40.881711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.916297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 837/1682] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:40 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:40.920516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.952371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d180266-0f81-45ed-85ad-b4cc31f0a445 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:40.965545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 846/1683] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:40.965819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:40.965937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:40.966769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:40.966769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:40.967359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:40.968708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:40.971415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:40.987267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6698bd95-e298-4e3a-83f0-963313eb35f3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.003063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.005119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 838/1684] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:41.006907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.007346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.007576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.007819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.010561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:41.010561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.021673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.033252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551074f8-0694-4852-9344-db5091314bd0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.058847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 847/1685] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:41.059235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.059883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.060174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.060596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.062105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.062950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.069151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.092214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebd098-0adc-48c3-a022-eb7fe78ed333 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.097368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 839/1686] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:41.100355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.126269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.128379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.128668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.128956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.131273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.138647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.143067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a9e64-868d-4411-be2b-eed39cf74536 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.174380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.178497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.181043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.181338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] PATH_INFO: `/v3/projects/e94a453b7f8a432e82fc31c8a4c012d3/users/1a11f9aeb41941b5a2a2896715c0d10f/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.245449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e94a453b7f8a432e82fc31c8a4c012d3, user_id=1a11f9aeb41941b5a2a2896715c0d10f, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.248434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 848/1687] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:41 2022] POST /identity/v3/projects => generated 403 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:35:41.251162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.252459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ab0ba3-f39e-4339-9048-8af52fbce869 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.302604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 840/1688] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:41 2022] PUT /identity/v3/projects/e94a453b7f8a432e82fc31c8a4c012d3/users/1a11f9aeb41941b5a2a2896715c0d10f/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:41.309535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.309826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.310132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.385930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] MFA Rules not processed for user `1a11f9aeb41941b5a2a2896715c0d10f`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:41.387544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:41.406527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec1f1c-1c8d-40c1-aaa6-cbc87ccb0c95 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.540985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 841/1689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:41.545694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.552708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.555106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.561345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.561674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.562484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.566610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a28fea-e9f6-4569-bd7b-352b4b48fe46 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.567541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.575263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.577402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.578956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.581625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.583010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.587287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.618815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 849/1690] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:41 2022] POST /identity/v3/users => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:41.620925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.633170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 842/1691] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:41 2022] POST /identity/v3/projects => generated 365 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:41.636918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.655081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c68d4db-1152-41c0-8809-9407d80fa246 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.753465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5fb5a9-93b0-4bc3-82c4-787f7b227e42 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.762246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.763010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.763379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.763665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.764581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.777497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.778359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:41.803121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:41.814891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 843/1692] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:41 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:41.818609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.829832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.830482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c81a2-573a-40cb-bee4-931eaa8d74f6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.830589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.835000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.835305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.836091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.841493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.843537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.843953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.844576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.845267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.846720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.852085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.874087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 850/1693] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:41.874849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.879641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 844/1694] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:41.883752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.905771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d9a667-35b3-41ac-8ccb-cfcb9de21fab admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.916033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57cddc-3ad2-46a3-99be-52a33ad1fa4f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:41.923594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.925028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.925322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.925596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.930041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:41.930316 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.930554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:41.931341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:41.931658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] PATH_INFO: `/v3/projects/fb2a6e63709349379fc98645be0fad42/users/ed2e7a97c0f44d37a33a66ef9e20e6b1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:41.934582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.951974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2a6e63709349379fc98645be0fad42, user_id=ed2e7a97c0f44d37a33a66ef9e20e6b1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:41.955123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:41.967336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 851/1695] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:41.969076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.979726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 845/1696] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:41 2022] PUT /identity/v3/projects/fb2a6e63709349379fc98645be0fad42/users/ed2e7a97c0f44d37a33a66ef9e20e6b1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:41.983903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:41.993511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ad37b2-23c3-4d30-959e-e4536fad64cf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:42.077248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e1fb47-e4f4-4a99-938d-eea11e0a774f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:42.083424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:42.084119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.084399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.084699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.085734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:42.088342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:42.112655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 846/1697] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:42.116426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:42.147867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a597ade-ad3f-48d9-92ce-bdf733d00af4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:42.155321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:42.170397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.172175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.172606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] PATH_INFO: `/v3/projects/fb2a6e63709349379fc98645be0fad42/users/ed2e7a97c0f44d37a33a66ef9e20e6b1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.181265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb2a6e63709349379fc98645be0fad42, user_id=ed2e7a97c0f44d37a33a66ef9e20e6b1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:42.182559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:42.186573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:42.189428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.189696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.189975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] PATH_INFO: `/v3/projects/99851bec618842a79f3b5fbd606f2eae/users/6ad0943eec274086b57d6c3e929bc631/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.235217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 847/1698] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:42 2022] PUT /identity/v3/projects/fb2a6e63709349379fc98645be0fad42/users/ed2e7a97c0f44d37a33a66ef9e20e6b1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:42.236344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:42.240236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:42.242254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=99851bec618842a79f3b5fbd606f2eae, user_id=6ad0943eec274086b57d6c3e929bc631, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:42.248002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a5a27d-e41b-4508-9142-1b9e68b970ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:42.279586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 852/1699] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:41 2022] PUT /identity/v3/projects/99851bec618842a79f3b5fbd606f2eae/users/6ad0943eec274086b57d6c3e929bc631/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:42.282180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ec8-18b3-4cdb-a687-d7c116610f5b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.282474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ec8-18b3-4cdb-a687-d7c116610f5b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.282751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064ec8-18b3-4cdb-a687-d7c116610f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.363705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6d064ec8-18b3-4cdb-a687-d7c116610f5b None None] MFA Rules not processed for user `ed2e7a97c0f44d37a33a66ef9e20e6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:42.366559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d064ec8-18b3-4cdb-a687-d7c116610f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:42.410804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7132cae3-446b-4cf8-beef-88a38063306e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:42.558969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:42.570541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:42.573667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.573949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.574264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] PATH_INFO: `/v3/projects/408d67e023fd4076bc343ab364ad389d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.575694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=408d67e023fd4076bc343ab364ad389d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:42.577690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:42.615621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 853/1700] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:42.618752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.619205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.619556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.649056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:42.653333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:42.658319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '408d67e023fd4076bc343ab364ad389d', 'request_id': 'req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:42.671625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '408d67e023fd4076bc343ab364ad389d', 'request_id': 'req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:42.687235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '408d67e023fd4076bc343ab364ad389d', 'request_id': 'req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:42.703185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:42.712757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] The token cache is being invalidate because project 408d67e023fd4076bc343ab364ad389d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:42.713108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:42.713845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-42d7dd87-de47-4b94-ad36-7d5c29cdd6d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:42.720518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 848/1701] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:42 2022] DELETE /identity/v3/projects/408d67e023fd4076bc343ab364ad389d => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:42.720518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a709-0c8e-43a6-8e00-0c0e8200c8fb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.720518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a709-0c8e-43a6-8e00-0c0e8200c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.720518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655a709-0c8e-43a6-8e00-0c0e8200c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:42.779656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e655a709-0c8e-43a6-8e00-0c0e8200c8fb None None] MFA Rules not processed for user `9bbb5d4487874bdd9f82e28651a418f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:42.789074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e655a709-0c8e-43a6-8e00-0c0e8200c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:42.801611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 854/1702] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:42.804298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:42.809365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:42.983731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 849/1703] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:42.985704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502ae1-b290-434a-92de-d92518200efb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:42.985995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502ae1-b290-434a-92de-d92518200efb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:42.987174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a502ae1-b290-434a-92de-d92518200efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.026328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e6ff66-ef5e-4e50-8f71-2878a4cd2034 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.041545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.044024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.044318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.044593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.050436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1a502ae1-b290-434a-92de-d92518200efb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:43.051598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1a502ae1-b290-434a-92de-d92518200efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.054099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.095535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 850/1704] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:43.100827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502ae1-b290-434a-92de-d92518200efb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.105224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1a502ae1-b290-434a-92de-d92518200efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.338030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.342866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e51510-35f7-4ddf-a9fc-109af5d8026a service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.345061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a502ae1-b290-434a-92de-d92518200efb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.372561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.373248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.373529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.374405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.394129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 855/1705] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:43.400680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.403898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.403898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.412901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.416749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1731c9-8892-4142-b2ce-4e1b9583ce96 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.461244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 851/1706] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:43.472706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.473188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.473465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.474673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] MFA Rules not processed for user `9bbb5d4487874bdd9f82e28651a418f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:43.491153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.511993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 856/1707] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:43.527770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.529564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.543339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:43.545636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.564752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 852/1708] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:43.572720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.581323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:43.603730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32eab9f-3bb8-41e2-974e-676d47a8ecaa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.623272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.624286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.625303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.626429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.630696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:43.631398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.633725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.676476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 853/1709] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:43.677874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.689821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7dd42-c457-4f10-a5e8-49456ab94d4e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.694894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.695848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.696306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.696726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.702025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:43.718092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63afac5c-f9aa-4971-8d0e-c402e48f182e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.732166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.733692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.734887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.735747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.757539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.762727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.771589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:43.789085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 857/1710] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:43.790598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.820166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b804f-34fe-40dd-b27a-97720e48ee76 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:43.832536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:43.833195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:43.833458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:43.833742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:43.835339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.840506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.842332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:43.844310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:43.864120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 854/1711] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:43.970864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 858/1712] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:43 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:43.974193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:43.993161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769734-b198-4597-8998-a92b93d65b47 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:44.208975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:44.209529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.209816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.214242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.215072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:44.217104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:44.282581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 855/1713] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:43 2022] POST /identity/v3/users => generated 294 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:44.286810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:44.302243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b38000-93e5-4d51-bd10-fbcad90b8c9c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:44.326449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:44.327686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.329117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.329734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.330659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:44.334914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:44.366098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:44.373418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 859/1714] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:44.382393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25483b7-abc0-442c-9f2c-6072dbad6ca0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:44.391162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:44.391875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.392160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.392441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.393194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:44.394884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fb17a7-62bf-476e-a8df-aa6a7a6ef1e3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:44.442110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 856/1715] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:44.444370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:44.471852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6966d-0436-4001-b2c9-899e6d902fff admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:44.498201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:44.499062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.499443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.499818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] PATH_INFO: `/v3/projects/2ebfc18eb1af4bc7936ce68b09f5b087/users/c30ea2c16536498cb23ac3565d9303bf/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.536173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebfc18eb1af4bc7936ce68b09f5b087, user_id=c30ea2c16536498cb23ac3565d9303bf, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:44.539237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:44.575719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 860/1716] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:44 2022] PUT /identity/v3/projects/2ebfc18eb1af4bc7936ce68b09f5b087/users/c30ea2c16536498cb23ac3565d9303bf/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:44.590657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.591009 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.591288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.669714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] MFA Rules not processed for user `c30ea2c16536498cb23ac3565d9303bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:44.671878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:44.751310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:44.776583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 857/1717] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:44.778021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:44.916615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d511efcf-2748-4b31-90d9-f86c5fccfabd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:44.928070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:44.929947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:44.930708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:44.931183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:44.932219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:44.935339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14059cc0-b0f4-40a6-91ad-34c5943104e6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:44.994733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 861/1718] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:44 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:44.999513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.015326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15647088-fdb7-436c-a7d1-e7fdaf34cb7d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.188904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.189887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.190407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.190829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.193661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:45.196549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:45.202306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60ddf-7aa2-4df6-8f27-73510a86e14a None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.202597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60ddf-7aa2-4df6-8f27-73510a86e14a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.202875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf60ddf-7aa2-4df6-8f27-73510a86e14a None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.204269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 862/1719] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jun 21 10:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 21 10:35:45.220263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f55e0-5036-430b-ba9a-dd2cac5cc408 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.220559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f55e0-5036-430b-ba9a-dd2cac5cc408 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.220857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f55e0-5036-430b-ba9a-dd2cac5cc408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.243297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 858/1720] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:44 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:45.244547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.264350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d542ec-65e8-4fe4-9843-6a35c9ec1729 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.276534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.277500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.277897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.278313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.279768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:45.282981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:45.298983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 859/1721] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:45.304560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.317950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54df99-d1a6-4203-9890-14ac6965ccf3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.319053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-563f55e0-5036-430b-ba9a-dd2cac5cc408 None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:45.320299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-563f55e0-5036-430b-ba9a-dd2cac5cc408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:45.327702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.329210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.329889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.330507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] PATH_INFO: `/v3/projects/b4763ab0976545829cf027f25dc6d9b4/users/8f2347575d3647c491f73e87393de6c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.355198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4763ab0976545829cf027f25dc6d9b4, user_id=8f2347575d3647c491f73e87393de6c8, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:45.368800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:45.411852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 860/1722] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:45 2022] PUT /identity/v3/projects/b4763ab0976545829cf027f25dc6d9b4/users/8f2347575d3647c491f73e87393de6c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:45.413873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.490230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 863/1723] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:45.492945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.495123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.495598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.548591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] MFA Rules not processed for user `5a3a6c87dbcb41eba4597f8a16651ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:45.550173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:45.551808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857fa960-5aae-4858-845a-78f3314dd74a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.558526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.559566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.560451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.560848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.561383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:45.563057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:45.565598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:45.603637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 861/1724] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:45.604886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.611503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:45.694494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 864/1725] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:45.694494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:45.725518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8eff6d-59ff-4236-8335-2927da7da78e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.747448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.748564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.749007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.749430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] PATH_INFO: `/v3/projects/b4763ab0976545829cf027f25dc6d9b4/users/8f2347575d3647c491f73e87393de6c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.755446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4763ab0976545829cf027f25dc6d9b4, user_id=8f2347575d3647c491f73e87393de6c8, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:45.764812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fcce4-28a6-49f2-a85f-c40c771649de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:45.777543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:45.788489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 865/1726] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:45 2022] PUT /identity/v3/projects/b4763ab0976545829cf027f25dc6d9b4/users/8f2347575d3647c491f73e87393de6c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:45.788489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816fa6-45cd-4ade-a1c8-136e5b285844 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.788489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816fa6-45cd-4ade-a1c8-136e5b285844 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.788489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b816fa6-45cd-4ade-a1c8-136e5b285844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.817275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57228694-3abc-42fa-a57b-82cde52c990a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:45.837655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5b816fa6-45cd-4ade-a1c8-136e5b285844 None None] MFA Rules not processed for user `5a3a6c87dbcb41eba4597f8a16651ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:45.839689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b816fa6-45cd-4ade-a1c8-136e5b285844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:45.984985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:45.985769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:45.986220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:45.986336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:45.994175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 866/1727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:46.006368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280d9-bc9e-4ff9-be28-60152aad1f3a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:46.007969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280d9-bc9e-4ff9-be28-60152aad1f3a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:46.008444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe280d9-bc9e-4ff9-be28-60152aad1f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:46.012925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:46.014460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4450566-cc41-40d8-937c-d0193f3b7f98 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:46.034696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 862/1728] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:46.037385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:46.037678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:46.038096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:46.080850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] MFA Rules not processed for user `f58d6e222d654e66b38fcefeff65fe80`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:46.082341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:46.087669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6fe280d9-bc9e-4ff9-be28-60152aad1f3a None None] MFA Rules not processed for user `8f2347575d3647c491f73e87393de6c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:46.091545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6fe280d9-bc9e-4ff9-be28-60152aad1f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:46.242841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 863/1729] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:46.249072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:46.251242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:46.304804 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 867/1730] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:46.312069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:46.312797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:46.314678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:46.433462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] MFA Rules not processed for user `6ad0943eec274086b57d6c3e929bc631`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:46.438453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:46.493565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f64c2-fa75-49db-9c30-a19ae2525872 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:46.507033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:46.507828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:46.508117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:46.508562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:46.510165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:46.528141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:46.531367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:46.555622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 864/1731] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:46.556597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:46.661082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:46.674419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 868/1732] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:46 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:46.679302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:46.687314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:46.729728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514aec42-55a5-44a1-b593-563e95438213 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:46.747762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:46.749082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:46.749572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:46.750030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:46.785877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:46.794964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:46.823912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 865/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:46.902243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.008012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbf5380-fc74-45ce-8736-eed3cb4abb18 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.023639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.024419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.024712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.025085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.025809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.033685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.117313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 869/1734] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:46 2022] POST /identity/v3/projects => generated 403 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:47.122429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.148000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ab83d1-4811-4364-8eea-5954a0f0f2ed service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.253136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc43de-d145-49e3-8537-fce470e4a1ee admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.275575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.277557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.277853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.278160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.278939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.281029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.314985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 870/1735] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:47 2022] POST /identity/v3/users => generated 308 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:35:47.314985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.328854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12550f-e8ee-4b78-bda7-402270ccf2ea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.345657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.346425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.346779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.352268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.357289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.360735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.395256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.397527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.397871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.398236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] PATH_INFO: `/v3/users/c30ea2c16536498cb23ac3565d9303bf` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.399905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c30ea2c16536498cb23ac3565d9303bf)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.408427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 871/1736] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:47.410318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.421997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.436593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b99bd-2abb-4868-931a-e154cf364c1f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.467745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.470692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.472679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.472966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] PATH_INFO: `/v3/projects/5fcb23fdd87f4644b656d4a9c548c186/users/26858e0472d74ef79f8df61773eef4e3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.509078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcb23fdd87f4644b656d4a9c548c186, user_id=26858e0472d74ef79f8df61773eef4e3, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.516677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cadad7-9abb-46c4-8583-e235070b733f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.541679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:47.559429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c30ea2c16536498cb23ac3565d9303bf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:47.564291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 872/1737] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:47 2022] PUT /identity/v3/projects/5fcb23fdd87f4644b656d4a9c548c186/users/26858e0472d74ef79f8df61773eef4e3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:47.568788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a660a-6493-4162-8307-cbfbc1cf7982 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.570891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a660a-6493-4162-8307-cbfbc1cf7982 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.571019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776a660a-6493-4162-8307-cbfbc1cf7982 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.579066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c30ea2c16536498cb23ac3565d9303bf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:47.579879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c30ea2c16536498cb23ac3565d9303bf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:47.582338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 873/1738] 10.222.0.43 () {54 vars in 960 bytes} [Tue Jun 21 10:35:47 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:47.585699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a660a-6493-4162-8307-cbfbc1cf7982 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.595206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c30ea2c16536498cb23ac3565d9303bf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:47.596278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-fc52a388-07a5-452a-b317-3a8f9c094487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c30ea2c16536498cb23ac3565d9303bf'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:47.673329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776a660a-6493-4162-8307-cbfbc1cf7982 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.679509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 866/1739] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:46 2022] DELETE /identity/v3/users/c30ea2c16536498cb23ac3565d9303bf => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:47.679815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8739-846c-4476-abef-88cfe502b3cf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.680752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8739-846c-4476-abef-88cfe502b3cf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.683473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315e8739-846c-4476-abef-88cfe502b3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.709085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:47.742996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-315e8739-846c-4476-abef-88cfe502b3cf None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:47.746333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-315e8739-846c-4476-abef-88cfe502b3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:47.846373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.847250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.848963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.848963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.849819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:47.852775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868eb7-4e36-40f2-b37a-b13d030f10d8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:47.894386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 874/1740] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:47 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:47.903978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.903978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.904299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.912530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 867/1741] 10.222.0.43 () {58 vars in 1057 bytes} [Tue Jun 21 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:47.914144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:47.914848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:47.918318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:47.923140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 868/1742] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jun 21 10:35:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:47.924216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.930153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:47.940520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:47.942974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:47.955348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 875/1743] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:47.956372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:47.985441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a732f-7cb0-48f2-9683-a6ae88be3b85 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.994469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685e72d-cdca-492b-94b3-366109d36f80 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:47.998645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:47.999798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.000143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.000550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] PATH_INFO: `/v3/projects/5fcb23fdd87f4644b656d4a9c548c186/users/26858e0472d74ef79f8df61773eef4e3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:48.009822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fcb23fdd87f4644b656d4a9c548c186, user_id=26858e0472d74ef79f8df61773eef4e3, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:48.012066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca7c24-0356-42a2-82d5-bc3f7ec288cd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:48.017394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:48.019243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.019582 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.019867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:48.031447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:48.062851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 869/1744] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:47 2022] PUT /identity/v3/projects/5fcb23fdd87f4644b656d4a9c548c186/users/26858e0472d74ef79f8df61773eef4e3/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:48.062851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.062851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.062851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:48.093115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:48.094814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:48.099367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:48.106098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:48.148985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 876/1745] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:48.150141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:48.157741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:48.248829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 870/1746] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:48.284809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:48.286953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:48.325107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda8e9f-df04-4d7e-a590-045274d49293 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:48.338707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8e6c3-baa2-46bc-abe0-252e04f76fdf service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:48.346509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:48.347228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.347530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.347708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:48.347816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:48.352690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.354354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.355482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:48.381254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:48.390713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ec143-b035-446c-943d-98abb7f93b66 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:48.418663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 871/1747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:48.496072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:48.560593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:48.562221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:48.589416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 877/1748] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:48.939451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479de81-e728-4a87-aa23-ca380fae562c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:48.939743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479de81-e728-4a87-aa23-ca380fae562c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:48.940027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479de81-e728-4a87-aa23-ca380fae562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:49.028296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3479de81-e728-4a87-aa23-ca380fae562c None None] MFA Rules not processed for user `9bbb5d4487874bdd9f82e28651a418f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:49.034736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3479de81-e728-4a87-aa23-ca380fae562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:49.166089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 872/1749] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:49.535964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:49.537924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:49.561521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f0bb0-4a69-44d2-b005-d75e70a9a926 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:49.592585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:49.595572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:49.595940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:49.602199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] PATH_INFO: `/v3/users/1a11f9aeb41941b5a2a2896715c0d10f` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:49.608037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a11f9aeb41941b5a2a2896715c0d10f)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:49.610140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:49.734391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a11f9aeb41941b5a2a2896715c0d10f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:49.752336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a11f9aeb41941b5a2a2896715c0d10f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:49.779534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a11f9aeb41941b5a2a2896715c0d10f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:49.780845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a11f9aeb41941b5a2a2896715c0d10f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:49.809067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a11f9aeb41941b5a2a2896715c0d10f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:49.826977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 878/1750] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:49 2022] DELETE /identity/v3/users/1a11f9aeb41941b5a2a2896715c0d10f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:49.829472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:49.830087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:49.830380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:49.883018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:49.892495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:50.073332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:50.177210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 873/1751] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:50.203335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:50.210964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:50.487966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda0a1-cbf0-4647-bd0e-85f4f668e064 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:50.543811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:50.543811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:50.543811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:50.543811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:50.594658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:50.600475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:50.642448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 879/1752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:50.712896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:50.714722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:50.762021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff532f-1cfe-4c17-9e53-7bfad5fa0690 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:50.784391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:50.788624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:50.795024 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:50.795588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] PATH_INFO: `/v3/projects/2ebfc18eb1af4bc7936ce68b09f5b087` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:50.801551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebfc18eb1af4bc7936ce68b09f5b087)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:50.828050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:51.089613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebfc18eb1af4bc7936ce68b09f5b087', 'request_id': 'req-4437884d-dde5-4e1a-8ede-f816e26b5e32'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.116212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebfc18eb1af4bc7936ce68b09f5b087', 'request_id': 'req-4437884d-dde5-4e1a-8ede-f816e26b5e32'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.119440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:51.125252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:51.144124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebfc18eb1af4bc7936ce68b09f5b087', 'request_id': 'req-4437884d-dde5-4e1a-8ede-f816e26b5e32'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.157847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c6c04-6969-42bf-95ea-6cbdf0f8ab75 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:51.189945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] The token cache is being invalidate because project 2ebfc18eb1af4bc7936ce68b09f5b087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:51.190252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.196178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.211028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 874/1753] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:50 2022] DELETE /identity/v3/projects/2ebfc18eb1af4bc7936ce68b09f5b087 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:51.212113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:51.219996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:51.346347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:51.403286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:51.404415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:51.408228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:51.408512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] PATH_INFO: `/v3/users/d7b074c550164bfd87c22800ba2a628a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:51.410774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b074c550164bfd87c22800ba2a628a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:51.418245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:51.451040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437884d-dde5-4e1a-8ede-f816e26b5e32 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:51.463793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:51.464621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:51.464884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:51.465162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] PATH_INFO: `/v3/users/8f2347575d3647c491f73e87393de6c8` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:51.466842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f2347575d3647c491f73e87393de6c8)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:51.468839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:51.529814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b074c550164bfd87c22800ba2a628a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.558656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b074c550164bfd87c22800ba2a628a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.597936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b074c550164bfd87c22800ba2a628a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.601140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b074c550164bfd87c22800ba2a628a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.608886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f2347575d3647c491f73e87393de6c8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.624900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:51.626677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f2347575d3647c491f73e87393de6c8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.628380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f2347575d3647c491f73e87393de6c8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.652901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f2347575d3647c491f73e87393de6c8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.653768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-497a9d88-a2b9-4548-a599-3f1c2a665148 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f2347575d3647c491f73e87393de6c8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.658544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8d20d97a-a50b-46d1-b00c-06c75c5e9ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b074c550164bfd87c22800ba2a628a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:51.683225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 875/1754] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:51 2022] DELETE /identity/v3/users/8f2347575d3647c491f73e87393de6c8 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:51.689158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:51.689725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:51.690285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:51.699731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 880/1755] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:51 2022] DELETE /identity/v3/users/d7b074c550164bfd87c22800ba2a628a => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:51.701571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:51.701867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:51.706401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:51.752997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] MFA Rules not processed for user `26858e0472d74ef79f8df61773eef4e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:51.761913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:51.799834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:51.802492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:52.067686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 876/1756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:52.116090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 881/1757] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:52.579940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:52.582026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:52.670498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:52.672728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:52.705433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0ea52c-4402-40c5-aa94-30274a98178a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:52.722180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:52.723098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:52.723384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:52.723669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] PATH_INFO: `/v3/projects/e94a453b7f8a432e82fc31c8a4c012d3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:52.728010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e94a453b7f8a432e82fc31c8a4c012d3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:52.730039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:52.829677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8e848f-9733-4f6c-8b73-98111ebed9e9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:52.841627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:52.843643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:52.844680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:52.845142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:52.875762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:52.878345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d994016-6b59-445b-9c97-b895b25ddd48 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:52.883004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e94a453b7f8a432e82fc31c8a4c012d3', 'request_id': 'req-73b3b72b-2c88-48e1-b143-158c40afb391'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:52.901045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 877/1758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:52.914573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e94a453b7f8a432e82fc31c8a4c012d3', 'request_id': 'req-73b3b72b-2c88-48e1-b143-158c40afb391'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:52.950153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:52.950326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:52.951615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:52.956259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e94a453b7f8a432e82fc31c8a4c012d3', 'request_id': 'req-73b3b72b-2c88-48e1-b143-158c40afb391'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:52.958396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:52.987363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:52.997737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] The token cache is being invalidate because project e94a453b7f8a432e82fc31c8a4c012d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:52.997846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.011522 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.012370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.022588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 882/1759] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:52 2022] DELETE /identity/v3/projects/e94a453b7f8a432e82fc31c8a4c012d3 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:53.026276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:53.028036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.223091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 878/1760] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:35:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:53.224990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:53.230014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.232699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3b72b-2c88-48e1-b143-158c40afb391 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:53.247169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:53.250488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.250799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.251085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] PATH_INFO: `/v3/users/ed2e7a97c0f44d37a33a66ef9e20e6b1` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.259951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2e7a97c0f44d37a33a66ef9e20e6b1)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:53.264065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:53.264534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:53.276526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ec384e-e8b7-4a5c-91f9-10c74366970f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:53.292652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:53.293850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.294165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.294651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] PATH_INFO: `/v3/projects/b4763ab0976545829cf027f25dc6d9b4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.297344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4763ab0976545829cf027f25dc6d9b4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:53.300358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:53.431804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4763ab0976545829cf027f25dc6d9b4', 'request_id': 'req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.453866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2e7a97c0f44d37a33a66ef9e20e6b1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.465462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4763ab0976545829cf027f25dc6d9b4', 'request_id': 'req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.485379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2e7a97c0f44d37a33a66ef9e20e6b1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.489431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4763ab0976545829cf027f25dc6d9b4', 'request_id': 'req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.527435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] The token cache is being invalidate because project b4763ab0976545829cf027f25dc6d9b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:53.527790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.530046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.538099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 879/1761] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:53 2022] DELETE /identity/v3/projects/b4763ab0976545829cf027f25dc6d9b4 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:53.538099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:53.542497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.562089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2e7a97c0f44d37a33a66ef9e20e6b1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.562884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2e7a97c0f44d37a33a66ef9e20e6b1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.589877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6ce06370-cb1f-4b2d-8907-0b1fa375d1da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2e7a97c0f44d37a33a66ef9e20e6b1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:53.599473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 883/1762] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:53 2022] DELETE /identity/v3/users/ed2e7a97c0f44d37a33a66ef9e20e6b1 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:53.603842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f87ae-7132-4958-bdb1-881e34c826bb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.603842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f87ae-7132-4958-bdb1-881e34c826bb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.603842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f87ae-7132-4958-bdb1-881e34c826bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.645424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cd5f87ae-7132-4958-bdb1-881e34c826bb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:53.649772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cd5f87ae-7132-4958-bdb1-881e34c826bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.789466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4e0c2-f8c6-4c7f-9075-38eac0ee7948 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:53.797298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 884/1763] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:53.798923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.799403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.799831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.827908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:53.829537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:53.846164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 885/1764] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:53.847345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:53.854234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:53.860635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62ea53-5c1a-46dc-a4f1-c190299bd53b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:53.869331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:53.870542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.871154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.872461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.873458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:53.873956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:53.875861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:53.899628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 886/1765] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:53.901082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:53.924883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18c4c0-3ab1-4136-b78e-9ccf4c2b0286 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:53.940825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:53.941792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.942335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.942750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.943701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:53.948385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:53.970603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:53.971315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:53.971598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:53.972088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:53.974160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:54.029025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:54.051229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 887/1766] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:53 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:54.055689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:54.101350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:54.109583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:54.144353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 880/1767] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:35:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:35:54.270786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3db09-9a31-42be-be7b-56a2dcf7b2a4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:54.290653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:54.291359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:54.291642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:54.291921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:54.292632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:54.296905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:54.352806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 888/1768] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:54 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:54.354780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:54.378431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21160c-676b-4f60-94d2-c9e1857d186f service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:54.400891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:54.404106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:54.404809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:54.405415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:54.406450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:54.408995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:54.471353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 881/1769] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:54.475409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:54.491821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b98997d-a210-4dd0-8c7c-94c6e218c209 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:54.504339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:54.505509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:54.506601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:54.510853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:54.511933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:54.513784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797dfa9-09db-43f3-bd03-5cf08f699e35 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:54.557977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 889/1770] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:54.565316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:54.579144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf2b8b-dc58-4ef9-a48e-395422e4bfa4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:54.594141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:54.599543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:54.601203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:54.603670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] PATH_INFO: `/v3/projects/d135e18c7b4248c399a4edf5c1bc29b7/users/3db73ee7d44a41999ec9fe93add646ff/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:54.641987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d135e18c7b4248c399a4edf5c1bc29b7, user_id=3db73ee7d44a41999ec9fe93add646ff, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:54.645232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:54.670382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 882/1771] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:54 2022] PUT /identity/v3/projects/d135e18c7b4248c399a4edf5c1bc29b7/users/3db73ee7d44a41999ec9fe93add646ff/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:54.684255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9072-982c-4287-9700-e593c82f533d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:54.684866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9072-982c-4287-9700-e593c82f533d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:54.685611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f9072-982c-4287-9700-e593c82f533d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:54.762713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-354f9072-982c-4287-9700-e593c82f533d None None] MFA Rules not processed for user `3db73ee7d44a41999ec9fe93add646ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:54.765555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-354f9072-982c-4287-9700-e593c82f533d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:55.031408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 890/1772] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:55.034106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:55.364347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f29f9-9534-4578-9fc1-87f4f41ab13e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:55.384970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:55.385779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.387134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.387426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.388289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:55.391601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:55.465627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 883/1773] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:55 2022] POST /identity/v3/projects => generated 387 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:55.472026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f9072-982c-4287-9700-e593c82f533d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:55.488939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f9072-982c-4287-9700-e593c82f533d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:55.591313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:55.699195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:55.700365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.700730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.701109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.702191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:55.704871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:55.747171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:55.748550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 891/1774] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:55 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:55.763874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4c4bf-f68e-4e8f-9618-4c2d0bf9fdfe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:55.777235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:55.778026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.778397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.778680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.779508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:55.781077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f472e-d5c9-4dd3-b19e-5e23ab7496df admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:55.806238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 884/1775] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:55.810609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:55.832987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b89e7-ff3f-40ef-9009-a1bb13982eb1 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.833370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b89e7-ff3f-40ef-9009-a1bb13982eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.833654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b89e7-ff3f-40ef-9009-a1bb13982eb1 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.835635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 885/1776] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:35:55.835770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6bd0ba-9cb3-403b-8dce-d87d2fe072ed admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:55.853590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:55.854685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.855220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.855716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.856852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:55.859267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:55.864377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.864674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.865010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.915468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:55.916718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:55.917921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 892/1777] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:55.921807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:55.944858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35d2951-717a-44d8-9f9b-2ad43d71757e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:55.963257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:55.964372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:55.964793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:55.965125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] PATH_INFO: `/v3/projects/e36068ea3ce1422986eafaf73bc7162c/users/c7af96ee869449d2ba6a9d8b53e80b6e/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:55.999587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e36068ea3ce1422986eafaf73bc7162c, user_id=c7af96ee869449d2ba6a9d8b53e80b6e, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:56.004227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aeff34-add7-4920-8bf1-0ebb07f13d2e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:56.069529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 893/1778] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:55 2022] PUT /identity/v3/projects/e36068ea3ce1422986eafaf73bc7162c/users/c7af96ee869449d2ba6a9d8b53e80b6e/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:56.085882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:56.086247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:56.086601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:56.138839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 886/1779] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:35:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:56.149802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] MFA Rules not processed for user `c7af96ee869449d2ba6a9d8b53e80b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:56.153049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:56.170922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:56.173397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:56.206114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea261d13-9c2d-4e9e-bf65-ce30dd6ea55f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:56.222384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:56.383539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 894/1780] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:56.390631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:56.448252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:56.449161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:56.449441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:56.449718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] PATH_INFO: `/v3/projects/576718e09ca44e47973f21fc2fe78ef3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:56.452499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=576718e09ca44e47973f21fc2fe78ef3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:56.455038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:56.567762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ee4c-48a9-4f14-b925-9a5d8c9f857c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:56.590628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '576718e09ca44e47973f21fc2fe78ef3', 'request_id': 'req-8f8e59b1-6536-4de1-99b8-1edb18dad473'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:56.609822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '576718e09ca44e47973f21fc2fe78ef3', 'request_id': 'req-8f8e59b1-6536-4de1-99b8-1edb18dad473'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:56.610258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:56.619237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '576718e09ca44e47973f21fc2fe78ef3', 'request_id': 'req-8f8e59b1-6536-4de1-99b8-1edb18dad473'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:56.648815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] The token cache is being invalidate because project 576718e09ca44e47973f21fc2fe78ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:56.649553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:56.652991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:56.668887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:56.670664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:56.670950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:56.671279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:56.672052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:56.674697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:56.675325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 887/1781] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:56 2022] DELETE /identity/v3/projects/576718e09ca44e47973f21fc2fe78ef3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:56.676432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:56.680252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:56.731865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 895/1782] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:56 2022] POST /identity/v3/projects => generated 385 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:35:56.733216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:56.735870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:56.936952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee8e608-ed98-456d-91da-13e9caa6f063 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:56.943529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:56.944460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:56.944837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:56.945075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] PATH_INFO: `/v3/users/6e2dad7540e14d8b9d3faa339d6cca26` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:56.948268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e2dad7540e14d8b9d3faa339d6cca26)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:56.950797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:56.954576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e59b1-6536-4de1-99b8-1edb18dad473 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.056695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e2dad7540e14d8b9d3faa339d6cca26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.073033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e2dad7540e14d8b9d3faa339d6cca26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.091792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e2dad7540e14d8b9d3faa339d6cca26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.093113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:57.094807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e2dad7540e14d8b9d3faa339d6cca26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.109929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e2dad7540e14d8b9d3faa339d6cca26'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.123735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 896/1783] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:56 2022] DELETE /identity/v3/users/6e2dad7540e14d8b9d3faa339d6cca26 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:57.127795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.131048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.198318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.199575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.201480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:57.202545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.202837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.215464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.285439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc0453-c5a9-4daa-89a0-2e3f0eb02b2e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.291732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.292251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.294729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.295040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.295362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] PATH_INFO: `/v3/users/b40df390292e489d82d56aae17b70fa9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.296760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b40df390292e489d82d56aae17b70fa9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.297648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:57.299335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:57.338518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 888/1784] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:57.339552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.347016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.389299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00b09f-2a95-4ab5-add9-0d9e79b7e7c3 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.395388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.396165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.396532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.396866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.397782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.403896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f337124e-db83-418c-af75-d57b1aa20fef admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:57.455971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 889/1785] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:57 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:57.457676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.457967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.458289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.515843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:57.517609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.532938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 890/1786] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:57.533940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.566814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8bff-e963-45c5-a8ed-cd081f3dd719 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.591273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.592326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.592550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.592880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.593718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.595488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:57.626185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 891/1787] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:57.630550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.653320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029cd517-d617-4d17-bdb1-9a4c51571237 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.667209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.668151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.668438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.668755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] PATH_INFO: `/v3/projects/f734f1afdd6f4acda15c6dd5c0041366/users/efccd6992b5543dcb31c7b3ce7004fc2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.695195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b40df390292e489d82d56aae17b70fa9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.713140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b40df390292e489d82d56aae17b70fa9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.732826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f734f1afdd6f4acda15c6dd5c0041366, user_id=efccd6992b5543dcb31c7b3ce7004fc2, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.735861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:57.749257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b40df390292e489d82d56aae17b70fa9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.751316 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b40df390292e489d82d56aae17b70fa9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.771166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b40df390292e489d82d56aae17b70fa9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:57.773270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 892/1788] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:57 2022] PUT /identity/v3/projects/f734f1afdd6f4acda15c6dd5c0041366/users/efccd6992b5543dcb31c7b3ce7004fc2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:35:57.774451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.783481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.789610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 897/1789] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:35:57 2022] DELETE /identity/v3/users/b40df390292e489d82d56aae17b70fa9 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:57.793890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:57.801836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:57.963428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1057d642-9753-4839-8cda-07ba3e5459d1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.965458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87ef8e5-f126-4c31-968c-6bd9d6c8646a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:57.970258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:57.971109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:57.971396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:57.971671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:57.972429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:57.974252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:58.004839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 898/1790] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:35:58.011542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:58.056732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab6a5b-805f-4002-9e68-2bc7c14d73f4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:58.064578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:58.066668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.067411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.067910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] PATH_INFO: `/v3/projects/f734f1afdd6f4acda15c6dd5c0041366/users/efccd6992b5543dcb31c7b3ce7004fc2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.075027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f734f1afdd6f4acda15c6dd5c0041366, user_id=efccd6992b5543dcb31c7b3ce7004fc2, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:58.082431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f89ce-5062-4a57-af6c-4acec66fdb28 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:58.096632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:58.097331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.097598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.097878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.105657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 899/1791] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:35:58 2022] PUT /identity/v3/projects/f734f1afdd6f4acda15c6dd5c0041366/users/efccd6992b5543dcb31c7b3ce7004fc2/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:58.115202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.116370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.116661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.116937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.146591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:58.148421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:58.162067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] MFA Rules not processed for user `efccd6992b5543dcb31c7b3ce7004fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:58.165694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.172103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 893/1792] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:35:58.200291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:58.259537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:58.261129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.284179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4e1778-1a10-4061-9453-7d319c1d300c service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:58.360411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 900/1793] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:35:58.370743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:58.372643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.412776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:58.538897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:58.539955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.540236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.540511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] PATH_INFO: `/v3/projects/fb2a6e63709349379fc98645be0fad42` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.542839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb2a6e63709349379fc98645be0fad42)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:58.544817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:58.647119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c100c-ff8f-4479-8c46-1298d3b12d6f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:58.663063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:58.663725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.665279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.665279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.695829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:58.698450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dbdf4f-00db-4144-ade1-e4085fe37142 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:58.736652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb2a6e63709349379fc98645be0fad42', 'request_id': 'req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:58.745172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 901/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:35:58.746895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.747249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.747526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.779051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb2a6e63709349379fc98645be0fad42', 'request_id': 'req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:58.796448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb2a6e63709349379fc98645be0fad42', 'request_id': 'req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:58.813518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:58.815212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.848328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] The token cache is being invalidate because project fb2a6e63709349379fc98645be0fad42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:58.848638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:58.851502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aacdfbe4-7da4-4cce-9c75-9ac573f33d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:58.854447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 894/1795] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:58 2022] DELETE /identity/v3/projects/fb2a6e63709349379fc98645be0fad42 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:58.861965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1abbc3-b541-41aa-b539-918a7c181182 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:58.862346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1abbc3-b541-41aa-b539-918a7c181182 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:58.862550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1abbc3-b541-41aa-b539-918a7c181182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:58.925431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-fa1abbc3-b541-41aa-b539-918a7c181182 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:58.926704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fa1abbc3-b541-41aa-b539-918a7c181182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.928001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 902/1796] 10.222.0.33 () {58 vars in 1015 bytes} [Tue Jun 21 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:58.959838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:58.961714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:58.981978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8081d36e-49c0-4b9e-9653-d8b97d92cfa6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:58.996842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:59.000772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.000772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.011252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.041811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:59.053729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:59.077625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 903/1797] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:35:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:35:59.083629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:59.088531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:59.137069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 895/1798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:59.149619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.149957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.151668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.213267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:59.221979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:59.239088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 896/1799] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:59.240621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:59.258099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a5b892-6e1b-4f8b-bb9b-3c707ae1109f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:59.264413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:59.265947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.266496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.267044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.268069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:35:59.268621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:59.271217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:59.293768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:59.294838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 897/1800] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:35:59.296202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:59.303227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d26d-d2f7-41ee-9331-9b6f6fe5efa7 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:59.311531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15828da-b0a2-4046-8698-f61f49a1c282 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:59.313246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:59.314139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.314427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.314707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] PATH_INFO: `/v3/projects/6db5a615db5c4e698c903e128c0c294b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.318843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6db5a615db5c4e698c903e128c0c294b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:59.319641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:59.321276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:59.321608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.322124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.322622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.323549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:35:59.326821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:35:59.395161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 898/1801] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:35:59 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:35:59.400395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:35:59.431823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6db5a615db5c4e698c903e128c0c294b', 'request_id': 'req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:59.448955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6db5a615db5c4e698c903e128c0c294b', 'request_id': 'req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:59.460707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6db5a615db5c4e698c903e128c0c294b', 'request_id': 'req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:59.484229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:35:59.565618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] The token cache is being invalidate because project 6db5a615db5c4e698c903e128c0c294b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:35:59.565968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:59.566875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c8b1b285-b8a7-401b-a72d-6e0ae2d1e46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:35:59.571198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 904/1802] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:35:59 2022] DELETE /identity/v3/projects/6db5a615db5c4e698c903e128c0c294b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:35:59.575837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9e3e-78cb-4e8a-ab92-d4aee734a1f6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.576125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9e3e-78cb-4e8a-ab92-d4aee734a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.576402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d9e3e-78cb-4e8a-ab92-d4aee734a1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.658881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0c6d9e3e-78cb-4e8a-ab92-d4aee734a1f6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:35:59.664589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0c6d9e3e-78cb-4e8a-ab92-d4aee734a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:35:59.717888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451bf797-0e90-4d67-92e4-413909c3ad8b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:35:59.944316 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 905/1803] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:35:59.950815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.951149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:35:59.951403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:35:59.998797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:35:59.999802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:35:59.999802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.000018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.000901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.006110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.018177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:00.019483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:00.029398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 906/1804] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:00.040974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.057623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bc74b-5d89-4686-a470-958ffe7cdf7f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.064044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.065245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.065560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.065859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.066838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:00.074042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.076049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.076402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 899/1805] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:35:59 2022] POST /identity/v3/users => generated 292 bytes in 679 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:00.081091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.087844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:00.094690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 907/1806] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:00.102618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.127788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b68ae0-1be5-4fc2-be12-68f45b32c329 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.136805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.137587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.137967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.138439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.139629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.141336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.143387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800886b-78dd-4607-9574-6657165ea814 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.150467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.151634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.152688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.153154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.156996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.159895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.163345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 900/1807] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:00.169023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.183989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d733a6-c4cd-40d7-87f2-27199309892f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.194281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.194281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.194653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.194816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.195789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.200007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.224599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 901/1808] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:00.227828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 908/1809] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:00 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:00.231664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.233002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.259011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91b70c-b480-4f17-a471-ff02e0dea596 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.361110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:00.366254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.368105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.369202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.369744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] PATH_INFO: `/v3/projects/54bb230657ce481eb6f019fafc70df52/users/43e93ba5dce846c7ad9228e16021166e/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.393467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=54bb230657ce481eb6f019fafc70df52, user_id=43e93ba5dce846c7ad9228e16021166e, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.396223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2c9d0-94e8-41dc-b7c4-1eda82fcf9fe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.430090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 902/1810] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:00 2022] PUT /identity/v3/projects/54bb230657ce481eb6f019fafc70df52/users/43e93ba5dce846c7ad9228e16021166e/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:00.430090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.430090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.430090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.432249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 903/1811] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:36:00.432249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:00.434727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:00.443351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9ca956-dd34-41ff-8871-4d5503e07b72 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.464418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:00.584757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f9e16-89e2-4a66-8350-a455365b4a3e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:00.601924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.603912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.605438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.605690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.613344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:00.658179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:00.658179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.658179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.658179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.660045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.665142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4531210-8814-4f19-8d8d-63414ebd98b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.744254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 909/1812] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:00 2022] POST /identity/v3/users => generated 289 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:00.751987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.752401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.752688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.835739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:00.842405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db7f352-c38f-4d39-9c9a-4bf4af1c4f72 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:00.865554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] MFA Rules not processed for user `43e93ba5dce846c7ad9228e16021166e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:00.867541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:00.881920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 904/1813] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:00.884532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:00.885029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:00.885513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:00.934300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] MFA Rules not processed for user `8b0728c2b6a3473fb4e08f81144c7b14`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:00.935555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.115077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 910/1814] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:01.115077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.123669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.169594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 905/1815] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:36:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:01.169882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21981cb-87c5-419b-ab93-0acf69369186 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.171335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.186604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b057d39-7756-492f-ad38-701466aa5588 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.188269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.190605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.190834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.194258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] PATH_INFO: `/v3/users/6ad0943eec274086b57d6c3e929bc631` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.200041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ad0943eec274086b57d6c3e929bc631)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:01.205957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:01.208783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.209976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.210520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.211091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.212319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:01.220071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:01.237231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 906/1816] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:01.245534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.248234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.264025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e776e-df6b-4789-bd4f-93ebba14efe1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.271701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.273254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.274819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.275338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] PATH_INFO: `/v3/projects/a2ede8feca3b403e99eb3cdeb33c74bf` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.278130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2ede8feca3b403e99eb3cdeb33c74bf)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:01.280451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:01.355093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ad0943eec274086b57d6c3e929bc631'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.393258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ad0943eec274086b57d6c3e929bc631'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.411761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:01.417855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2ede8feca3b403e99eb3cdeb33c74bf', 'request_id': 'req-48ad86fe-d096-487f-a73b-109e65644a86'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.419572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ad0943eec274086b57d6c3e929bc631'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.420421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ad0943eec274086b57d6c3e929bc631'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.420545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:01.434411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2ede8feca3b403e99eb3cdeb33c74bf', 'request_id': 'req-48ad86fe-d096-487f-a73b-109e65644a86'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.449175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ad0943eec274086b57d6c3e929bc631'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.449439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2ede8feca3b403e99eb3cdeb33c74bf', 'request_id': 'req-48ad86fe-d096-487f-a73b-109e65644a86'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.455867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 911/1817] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:01 2022] DELETE /identity/v3/users/6ad0943eec274086b57d6c3e929bc631 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:01.470599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.475821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.494832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] The token cache is being invalidate because project a2ede8feca3b403e99eb3cdeb33c74bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:01.495188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.496326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:01.503585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 907/1818] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:01 2022] DELETE /identity/v3/projects/a2ede8feca3b403e99eb3cdeb33c74bf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:01.505972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.508994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.649770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4392c5b-b204-4869-ba58-8f725d1d7526 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.662965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.663840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.664278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.664651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.666150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:01.668500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:01.725712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad86fe-d096-487f-a73b-109e65644a86 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.737701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 912/1819] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:01 2022] POST /identity/v3/projects => generated 383 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:01.738874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.742814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.757376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.762248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.762248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.763452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.766286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:01.769340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:01.802622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 908/1820] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:01.806885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:01.811472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.848248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594b7613-f576-4833-90fd-f24c675c1cd5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.952575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec47a7-774a-4196-9fbb-b24bf7799ea2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:01.959196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.960158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.960410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.960758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:01.963571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:01.993483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:01.996177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:01.998197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:01.999188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] PATH_INFO: `/v3/users/ce2bd4226d6141be9a6e2b54d82ab386` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.004537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2bd4226d6141be9a6e2b54d82ab386)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.008385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.009496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.012848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.040074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 913/1821] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:02.042903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:02.045900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:02.092520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4b54b-8e3a-47fc-b8b5-9a73bc366bbe service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:02.127107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:02.130627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.131037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.131407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.134034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.135069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.163370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2bd4226d6141be9a6e2b54d82ab386'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:02.197650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2bd4226d6141be9a6e2b54d82ab386'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:02.201948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2bd4226d6141be9a6e2b54d82ab386'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:02.249868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 914/1822] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:02 2022] POST /identity/v3/users => generated 298 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:02.250902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:02.255451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2bd4226d6141be9a6e2b54d82ab386'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:02.257179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2bd4226d6141be9a6e2b54d82ab386'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:02.309094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630a39-e602-4ea9-9601-330fb6668e84 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:02.316569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:02.327703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:02.331302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.331302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.331302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] PATH_INFO: `/v3/projects/38f0d0f281ee4b609a47bf1ce29bf4c0/users/85f464dbb50c4974baeb17bbf3766c1e/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.352551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 909/1823] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:01 2022] DELETE /identity/v3/users/ce2bd4226d6141be9a6e2b54d82ab386 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:02.356301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:02.364051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:02.383932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f0d0f281ee4b609a47bf1ce29bf4c0, user_id=85f464dbb50c4974baeb17bbf3766c1e, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.386911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff3186-51e5-45f2-956a-88b9e379d71d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.421990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 915/1824] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:02 2022] PUT /identity/v3/projects/38f0d0f281ee4b609a47bf1ce29bf4c0/users/85f464dbb50c4974baeb17bbf3766c1e/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:02.432825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.433070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.433285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.509900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] MFA Rules not processed for user `85f464dbb50c4974baeb17bbf3766c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:02.514445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:02.522974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:02.616194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b981788-a0ce-4ac2-a645-c86143779f80 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:02.692669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 916/1825] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:02.711281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:02.713330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:02.821752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:02.822806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.824581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.824885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.827842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.834423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.864242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 910/1826] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:02 2022] GET /identity/v3/roles => generated 1420 bytes in 506 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:02.865861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:02.897746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccd7db-99d2-4d7f-b183-e59fb0967c66 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:02.916460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:02.918516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.921435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.922994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] PATH_INFO: `/v3/projects/b52eaa7ddf8247819ac9964c96482688/users/f914c306c0b94511a5670dd3d51ca601/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.931899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e8ea99-094e-4cd0-aa1f-8925d8a3249c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:02.951487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:02.952240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:02.952613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:02.952936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:02.955215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.960070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:02.974096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52eaa7ddf8247819ac9964c96482688, user_id=f914c306c0b94511a5670dd3d51ca601, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:02.977177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.017280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 911/1827] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:02 2022] PUT /identity/v3/projects/b52eaa7ddf8247819ac9964c96482688/users/f914c306c0b94511a5670dd3d51ca601/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:03.034838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.054703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 917/1828] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:02 2022] POST /identity/v3/projects => generated 377 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:03.061094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.244655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ae107-4cc4-41a4-af77-ec0a4295ec84 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.262635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.263481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.263874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.264315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.265125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.270103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.281705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f2343-41e6-4c87-b179-157d96ca5fd2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.294516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.296642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.297741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.298755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.299470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.301591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.324833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 918/1829] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:03 2022] POST /identity/v3/users => generated 295 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:03.330590 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.338097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:03.354339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 912/1830] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:03.355355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.384442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa9f7a0-1665-4a34-9a77-490b3fd494d7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.388387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422f3db-0b86-4b9c-bd37-ad39db93eb64 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.410206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.412160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.413742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.414749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.415692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.416413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] PATH_INFO: `/v3/projects/99851bec618842a79f3b5fbd606f2eae` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.418559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.419051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.421326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99851bec618842a79f3b5fbd606f2eae)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.421794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.427331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.427701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.434237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:03.467633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 913/1831] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:03 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:03.468813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.489900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8799d-02d0-4abc-bf7c-f79e355fe23f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.490909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:03.526909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.530336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.532203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.541661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] PATH_INFO: `/v3/projects/b52eaa7ddf8247819ac9964c96482688/users/f914c306c0b94511a5670dd3d51ca601/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.545489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52eaa7ddf8247819ac9964c96482688, user_id=f914c306c0b94511a5670dd3d51ca601, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.548991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.568629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99851bec618842a79f3b5fbd606f2eae', 'request_id': 'req-cb4d7dd7-8a9e-4653-a158-d1e107a94314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:03.582798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 914/1832] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:03 2022] PUT /identity/v3/projects/b52eaa7ddf8247819ac9964c96482688/users/f914c306c0b94511a5670dd3d51ca601/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:03.584928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.594599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99851bec618842a79f3b5fbd606f2eae', 'request_id': 'req-cb4d7dd7-8a9e-4653-a158-d1e107a94314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:03.604915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99851bec618842a79f3b5fbd606f2eae', 'request_id': 'req-cb4d7dd7-8a9e-4653-a158-d1e107a94314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:03.624468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] The token cache is being invalidate because project 99851bec618842a79f3b5fbd606f2eae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:03.624679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:03.625323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb4d7dd7-8a9e-4653-a158-d1e107a94314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:03.627909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 919/1833] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:03 2022] DELETE /identity/v3/projects/99851bec618842a79f3b5fbd606f2eae => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:03.630092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.630381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.630742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.735335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] MFA Rules not processed for user `f914c306c0b94511a5670dd3d51ca601`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:03.737149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:03.785856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e3051-1ab6-45c8-a0d1-d5630653c9ec admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:03.812820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:03.813747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:03.814131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:03.814331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] PATH_INFO: `/v3/projects/274121763c9b45ccbe23d281b967113f/users/1af903050a824828a796f3cbd88d849e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:03.858946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274121763c9b45ccbe23d281b967113f, user_id=1af903050a824828a796f3cbd88d849e, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:03.862156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:03.884566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 915/1834] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:03 2022] PUT /identity/v3/projects/274121763c9b45ccbe23d281b967113f/users/1af903050a824828a796f3cbd88d849e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:03.885475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:03.892262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.010540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 920/1835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:03 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:04.018403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:04.024158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.054719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9178183-34b8-4a2e-b629-7099cf0f00af None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:04.087371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9479b995-2bba-4d23-82c8-bb2bbb731fc4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:04.092950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:04.100032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.100289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.100559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] PATH_INFO: `/v3/users/26858e0472d74ef79f8df61773eef4e3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.114557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26858e0472d74ef79f8df61773eef4e3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:04.116553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:04.241880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:04.244352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.244662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.244994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.248924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:04.254086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14f22f4-325c-4f9c-8930-2b33529d8952 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:04.265748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26858e0472d74ef79f8df61773eef4e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:04.294851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26858e0472d74ef79f8df61773eef4e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:04.294851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26858e0472d74ef79f8df61773eef4e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 921/1836] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 922/1837] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:36:04.295182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:04.297278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.319854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26858e0472d74ef79f8df61773eef4e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:04.320523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26858e0472d74ef79f8df61773eef4e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:04.328494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:04.376023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 916/1838] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:03 2022] DELETE /identity/v3/users/26858e0472d74ef79f8df61773eef4e3 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:04.382310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:04.386687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.397764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:04.476940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d3ae0-1edc-45b7-8def-94b280c37a3b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:04.633408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:04.636902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.637316 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.637662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.641759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.642694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028096a-9299-4f69-a3d2-c9f9bf1d53d4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:04.656131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:04.657786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.658314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.658891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] PATH_INFO: `/v3/projects/274121763c9b45ccbe23d281b967113f/users/1af903050a824828a796f3cbd88d849e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.662889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274121763c9b45ccbe23d281b967113f, user_id=1af903050a824828a796f3cbd88d849e, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:04.669131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051790-cb1c-4d45-9ebe-68adfa096535 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:04.736571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 917/1839] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:04 2022] PUT /identity/v3/projects/274121763c9b45ccbe23d281b967113f/users/1af903050a824828a796f3cbd88d849e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:04.745156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.745691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.746763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:04.803610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:04.808414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:04.911807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:04.918408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040cbcc-13fe-4851-83f2-d87d07cdd104 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:04.975333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 923/1840] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:04.984518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:04.984884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:04.985173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:05.127702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 918/1841] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:05.131058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] MFA Rules not processed for user `1af903050a824828a796f3cbd88d849e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:05.132527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.296271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 924/1842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:04 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:05.329588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:05.329699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:05.331128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.333011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.369595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:05.483440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209dbc-201c-4b26-9661-7bf2294e7868 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:05.491320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:05.494314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5ab4b-39fa-45df-a544-09ef7bce07c7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:05.494905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:05.496358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:05.496746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:05.501780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.504159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:05.505711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:05.506832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:05.508384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:05.512334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.666396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:05.666396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:05.687990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:05.698192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 925/1843] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:05.699861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:05.706885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.810182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:05.811886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:05.835242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 919/1844] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:05.866648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:05.868948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:05.898619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f04c0-0a8d-41ff-b27e-38cc5b2db75f service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:05.916190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:05.916879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:05.917165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:05.917461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:05.928602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:05.930519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:05.944643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 920/1845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:36:05.998511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966467-b590-4761-a73d-d238441dfabd service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:06.018547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:06.019461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:06.019754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:06.020247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] PATH_INFO: `/v3/projects/03defe771c234365803c14bc9d57d0e4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:06.026852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03defe771c234365803c14bc9d57d0e4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:06.037927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:06.210965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03defe771c234365803c14bc9d57d0e4', 'request_id': 'req-82a22521-5c87-444f-b18c-0799f9180499'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.232129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03defe771c234365803c14bc9d57d0e4', 'request_id': 'req-82a22521-5c87-444f-b18c-0799f9180499'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.246248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03defe771c234365803c14bc9d57d0e4', 'request_id': 'req-82a22521-5c87-444f-b18c-0799f9180499'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.301828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:06.304936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:06.314735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] The token cache is being invalidate because project 03defe771c234365803c14bc9d57d0e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:06.314735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.314735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-82a22521-5c87-444f-b18c-0799f9180499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.316045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 926/1846] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:05 2022] DELETE /identity/v3/projects/03defe771c234365803c14bc9d57d0e4 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:06.322396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523e0e-ece5-4693-96b4-ecf41cd6f474 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:06.322708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523e0e-ece5-4693-96b4-ecf41cd6f474 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:06.323002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b523e0e-ece5-4693-96b4-ecf41cd6f474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:06.354887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ffd78-e545-429e-ad0e-a8abf32c13ab service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:06.357880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:06.428089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4b523e0e-ece5-4693-96b4-ecf41cd6f474 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:06.429881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b523e0e-ece5-4693-96b4-ecf41cd6f474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:06.621835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:06.624070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:06.625049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:06.626130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] PATH_INFO: `/v3/projects/5fcb23fdd87f4644b656d4a9c548c186` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:06.628717 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fcb23fdd87f4644b656d4a9c548c186)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:06.633824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:06.776330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fcb23fdd87f4644b656d4a9c548c186', 'request_id': 'req-9101621c-461e-45c1-bff4-96031f7f364d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.797708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fcb23fdd87f4644b656d4a9c548c186', 'request_id': 'req-9101621c-461e-45c1-bff4-96031f7f364d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.808624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fcb23fdd87f4644b656d4a9c548c186', 'request_id': 'req-9101621c-461e-45c1-bff4-96031f7f364d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.808875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 927/1847] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:06.810745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:06.811078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:06.811399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:06.851286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] The token cache is being invalidate because project 5fcb23fdd87f4644b656d4a9c548c186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:06.851286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.854548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9101621c-461e-45c1-bff4-96031f7f364d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:06.860764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:06.860982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 921/1848] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:06 2022] DELETE /identity/v3/projects/5fcb23fdd87f4644b656d4a9c548c186 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:06.862190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:06.862387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:06.862686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:06.862971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:06.928639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:06.931593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.078110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 928/1849] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:07.078110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:07.080720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.114349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:07.182908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 922/1850] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:07.185523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:07.196068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5b754-f141-42f5-a945-6a666793a675 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:07.203617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:07.204807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.205096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.205613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.216581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.235008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a7bdcd-d47f-4495-9506-e8ba33e3665f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:07.259363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:07.265319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.265965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.266558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.275595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:07.277278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:07.279590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:07.334683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 923/1851] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:07.335792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:07.340904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.368007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee41312a-42b9-45d8-b78e-ae451aca9042 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:07.373475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:07.375197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcef672-24c4-4cd0-9b9f-3cabade51e1b service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:07.383434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:07.395059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:07.397233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.397233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.397233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] PATH_INFO: `/v3/users/43e93ba5dce846c7ad9228e16021166e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.399418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=43e93ba5dce846c7ad9228e16021166e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:07.402269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:07.434712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 929/1852] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:07.436456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.436752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.437026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.496045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:07.497469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.526303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 930/1853] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:07.527218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:07.554741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43e93ba5dce846c7ad9228e16021166e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:07.566220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483b424-a24d-4c13-858d-531c0d8db5eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:07.575912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43e93ba5dce846c7ad9228e16021166e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:07.576912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43e93ba5dce846c7ad9228e16021166e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:07.583954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:07.584686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.584964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.585237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.586642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:07.588773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31872259-24df-401d-a88b-2ee4dadf96e3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:07.596611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43e93ba5dce846c7ad9228e16021166e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:07.597424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43e93ba5dce846c7ad9228e16021166e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:07.639274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 924/1854] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:07 2022] DELETE /identity/v3/users/43e93ba5dce846c7ad9228e16021166e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:07.639651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:07.643187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:07.708556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 931/1855] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:07 2022] POST /identity/v3/projects => generated 401 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:07.712916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:07.713249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:07.713540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:07.842538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3117c241-de10-4026-b9e0-041ac4970d2c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:07.844819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:07.846975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:08.032855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:08.068104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.069743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.071987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.072608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.074271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:08.074842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.080167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a84a8-b6d8-487e-983a-d42eba355868 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.092549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 932/1856] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:08.095832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.099735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:08.137489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848d446-b40b-4270-8890-9a1145aecb75 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.152577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 925/1857] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 515 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:08.157069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.157791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.158082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.158373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.161364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.167588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8332bd-795f-4fac-87ed-792983531bd6 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.168041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8332bd-795f-4fac-87ed-792983531bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.168219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.168323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8332bd-795f-4fac-87ed-792983531bd6 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.179744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 926/1858] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:36:08 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:36:08.181371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8332bd-795f-4fac-87ed-792983531bd6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.221163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8332bd-795f-4fac-87ed-792983531bd6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.236525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 933/1859] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:08 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:08.239485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.246520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.250992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.251771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.253189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.255439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.271820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.297610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d7d8-154c-44db-949b-0d0fa8ff135e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.313949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.325688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.326217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.326515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.329665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.332030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.363856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 934/1860] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:08.367864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.376462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 927/1861] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:08 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:08.377328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:08.381170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.504104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8062d-ed14-4058-b659-9b3d4e2e37eb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.621523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.623878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.624155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.624427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.652240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:08.652596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f6f124-33bf-4600-8819-36d2773719a4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.658630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.659397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.659807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.660087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.660903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.663421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.684439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 928/1862] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:08.684439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.709153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e03e808-4b40-49a6-9f08-2d13b0760c75 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.718001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.718766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.719052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.719473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.720389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.724508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ef3b8-87c2-4ed8-b233-e6c224897be1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.781209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 929/1863] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:08 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:08.782391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0adf-20e2-446a-997c-64cba013eaf8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.782672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0adf-20e2-446a-997c-64cba013eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.782943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e0adf-20e2-446a-997c-64cba013eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.787702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.790103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.812459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 935/1864] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:08.813325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.824060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a03e0adf-20e2-446a-997c-64cba013eaf8 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:08.826650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a03e0adf-20e2-446a-997c-64cba013eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:08.836861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d3fde-00b6-40c7-a299-1897f38b0203 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:08.859559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:08.860852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.861285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.861560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] PATH_INFO: `/v3/projects/e66361c002ea4a138c58cf7b2429e613/users/87c5cf6658034dfc88f99c6dbd6c93dc/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:08.897618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66361c002ea4a138c58cf7b2429e613, user_id=87c5cf6658034dfc88f99c6dbd6c93dc, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:08.901463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:08.924883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 936/1865] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:08 2022] PUT /identity/v3/projects/e66361c002ea4a138c58cf7b2429e613/users/87c5cf6658034dfc88f99c6dbd6c93dc/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:08.926009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:08.979077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 930/1866] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:08.980494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:08.980966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:08.981218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.028906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] MFA Rules not processed for user `87c5cf6658034dfc88f99c6dbd6c93dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:09.030221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.048915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bc182-3190-468f-b9a3-2508130d70b9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.054102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.055170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.055460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.055786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.056975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.058799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.072323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 937/1867] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:08 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:09.073496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.076595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.088647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.160415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 931/1868] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:09.161652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.175258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6326024-d4f0-4d9c-8239-971b370e677a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.177967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa07f0e-1d16-4423-b23f-2aa60de35812 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.181310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.181732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.182014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.182338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.183342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.184433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.185001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.185215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.186113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.186113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.199547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 932/1869] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:09.199978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.200061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.200147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.207898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75570403-1536-49e9-ad27-752a20054123 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.213281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.213983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.214297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.214569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.215278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.217243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.221616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 938/1870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:09.222840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.233921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.239835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81b8b8-023c-4866-8830-81a3682c76a8 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.247134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.248633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.249173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.249708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] PATH_INFO: `/v3/projects/2083ebbb231843efaef49da9aa67ab55/users/62eb389f889f4d6ab7264e54f643c4ef/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.273131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2083ebbb231843efaef49da9aa67ab55, user_id=62eb389f889f4d6ab7264e54f643c4ef, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.276803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11e84d-ec65-426b-94ed-fe2e3d05f78e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.284782 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 933/1871] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/projects => generated 401 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:09.289612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.294881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 939/1872] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:09 2022] PUT /identity/v3/projects/2083ebbb231843efaef49da9aa67ab55/users/62eb389f889f4d6ab7264e54f643c4ef/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:09.310740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.311100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.311387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.352852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] MFA Rules not processed for user `62eb389f889f4d6ab7264e54f643c4ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:09.358349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.377912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d95a4-6609-4ef2-ad37-de25926c77f7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.442469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 940/1873] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:09.443439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.444821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.449891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.450616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.450898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.451173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.451866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.453871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.459028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697db0ff-4416-4c73-b9be-68b059dcda71 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.464252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.465130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.465583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.465809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] PATH_INFO: `/v3/projects/54bb230657ce481eb6f019fafc70df52` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.467052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54bb230657ce481eb6f019fafc70df52)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.469292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.476816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 934/1874] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/users => generated 307 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:09.477673 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.489171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788a862-e263-4890-8bf0-84d7dea0bfe7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.494455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.495127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.495406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.495684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.496384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.498352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.523479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54bb230657ce481eb6f019fafc70df52', 'request_id': 'req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.530734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 935/1875] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:09.531601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.534658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54bb230657ce481eb6f019fafc70df52', 'request_id': 'req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.537470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.542432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54bb230657ce481eb6f019fafc70df52', 'request_id': 'req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.553833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] The token cache is being invalidate because project 54bb230657ce481eb6f019fafc70df52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:09.554163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.555020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.556548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 941/1876] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:09 2022] DELETE /identity/v3/projects/54bb230657ce481eb6f019fafc70df52 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:09.557343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.561524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.601054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e405-f927-43ea-bc6e-b1d7eb92b02e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.606149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.606842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.607127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.607408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.608270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.609824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.617768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.621628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 936/1877] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:09.622647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.629116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.634026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b55b03a-e3c0-4c7c-8a44-bfa2f63bb3e1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.639389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.640078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.640359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.640640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.641334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.643335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.643461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f77c67-ce5a-4aa8-a4d0-74b006ab68a2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.649456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.650417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.650709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.650985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] PATH_INFO: `/v3/users/f914c306c0b94511a5670dd3d51ca601` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.652348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=f914c306c0b94511a5670dd3d51ca601)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.654714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.665737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 942/1878] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:09.669068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.669068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.680759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad264b8-c67e-4680-abaf-01a6d681454d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.686159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.687101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.687427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.687703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] PATH_INFO: `/v3/projects/203169f572ab427b836f7ef773197ff3/users/623b00f26a9b4b92b4894199035ebb34/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.704510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] RBAC: Authorizing `identity:create_grant(project_id=203169f572ab427b836f7ef773197ff3, user_id=623b00f26a9b4b92b4894199035ebb34, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.707745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.711435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f914c306c0b94511a5670dd3d51ca601'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.720712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f914c306c0b94511a5670dd3d51ca601'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.721973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f914c306c0b94511a5670dd3d51ca601'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.727061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 943/1879] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:09 2022] PUT /identity/v3/projects/203169f572ab427b836f7ef773197ff3/users/623b00f26a9b4b92b4894199035ebb34/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:09.727061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.735159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f914c306c0b94511a5670dd3d51ca601'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.735904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f914c306c0b94511a5670dd3d51ca601'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:09.755087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 937/1880] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:09 2022] DELETE /identity/v3/users/f914c306c0b94511a5670dd3d51ca601 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:09.756116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.757562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.806101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a584e3e-bb4e-49c9-bb38-15dd2f8b387f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.834759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5652de-5b5a-4be9-81d5-4505cc2461ad admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.840355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.841044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.841341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.841636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.842390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.844010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.863705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 938/1881] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:09.868843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.883603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895f2be2-3ace-4b18-a857-7844e2412881 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.886933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.887635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.887914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.888187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.889035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:09.889173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.889959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.890303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.890682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] PATH_INFO: `/v3/projects/203169f572ab427b836f7ef773197ff3/users/623b00f26a9b4b92b4894199035ebb34/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.891372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.893165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] RBAC: Authorizing `identity:create_grant(project_id=203169f572ab427b836f7ef773197ff3, user_id=623b00f26a9b4b92b4894199035ebb34, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:09.896983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2714fe-2fa7-45bd-8305-99b64ee6287a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:09.906571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:09.910179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 944/1882] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:09.911774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:09.913989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:09.916760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 939/1883] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:09 2022] PUT /identity/v3/projects/203169f572ab427b836f7ef773197ff3/users/623b00f26a9b4b92b4894199035ebb34/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:09.928872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:09.929346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:09.929664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:09.950963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aebc44-d50c-4287-903c-013210af27dd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:09.992901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] MFA Rules not processed for user `623b00f26a9b4b92b4894199035ebb34`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:09.995246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.087189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.088491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.090286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.090947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] PATH_INFO: `/v3/projects/697af989f3d3484e9aeff2edea6cb70b/users/5943549ddd5e458eab6caaaf0ff707c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.097996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:10.127589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697af989f3d3484e9aeff2edea6cb70b, user_id=5943549ddd5e458eab6caaaf0ff707c8, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.140216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.143092 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 940/1884] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:09 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:10.156071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.159049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.169444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 945/1885] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:09 2022] PUT /identity/v3/projects/697af989f3d3484e9aeff2edea6cb70b/users/5943549ddd5e458eab6caaaf0ff707c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:10.173221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.253010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582a46a-d334-4cf3-8103-66bd0de5b5af None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.286515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f3ae51-52c6-4eda-93bf-d4d253ff18e5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.294400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.295106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.295390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.295670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.296414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.300601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.318525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 946/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:10.321497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.324162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.346188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c77ab-5205-4966-8506-100faa176399 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.352570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.352948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.353244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.353646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] PATH_INFO: `/v3/projects/b52eaa7ddf8247819ac9964c96482688` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.355186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52eaa7ddf8247819ac9964c96482688)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.357216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.360949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.361713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.362199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.362528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.439825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52eaa7ddf8247819ac9964c96482688', 'request_id': 'req-675bab34-6756-4543-a91e-2da17027fe05'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:10.455363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52eaa7ddf8247819ac9964c96482688', 'request_id': 'req-675bab34-6756-4543-a91e-2da17027fe05'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:10.460655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:10.464819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52eaa7ddf8247819ac9964c96482688', 'request_id': 'req-675bab34-6756-4543-a91e-2da17027fe05'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:10.478928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] The token cache is being invalidate because project b52eaa7ddf8247819ac9964c96482688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:10.479224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.479586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:10.480387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:10.480667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62f00d-71d1-4831-8d55-8fc64c5e1c6a service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.483109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 947/1887] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:10 2022] DELETE /identity/v3/projects/b52eaa7ddf8247819ac9964c96482688 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:10.483981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.485394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.493539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 941/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:10.495041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.495393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.495674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.516491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:10.518530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.608980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 942/1889] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:10.609801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.611221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.620167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675bab34-6756-4543-a91e-2da17027fe05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.625157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.626127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.626402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.626685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] PATH_INFO: `/v3/projects/697af989f3d3484e9aeff2edea6cb70b/users/5943549ddd5e458eab6caaaf0ff707c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.628810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697af989f3d3484e9aeff2edea6cb70b, user_id=5943549ddd5e458eab6caaaf0ff707c8, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.631531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864bf57e-5e5d-40a6-9ea9-7bd640d12e45 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.637776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:10.645030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 948/1890] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:10 2022] PUT /identity/v3/projects/697af989f3d3484e9aeff2edea6cb70b/users/5943549ddd5e458eab6caaaf0ff707c8/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:10.646502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5323-7a47-462b-b44c-8fb43b67481b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.646802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5323-7a47-462b-b44c-8fb43b67481b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.647091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc5323-7a47-462b-b44c-8fb43b67481b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.668941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-16bc5323-7a47-462b-b44c-8fb43b67481b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:10.670680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-16bc5323-7a47-462b-b44c-8fb43b67481b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.695518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10888f1-adeb-4b2c-b0e4-bda66d271aa2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.747710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 949/1891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:10.749045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.749373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.749604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.751819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.752513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.752791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.753060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.755014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.776753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] MFA Rules not processed for user `5943549ddd5e458eab6caaaf0ff707c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:10.777992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.816941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.818543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.822871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:10.830155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 943/1892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:10.830988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.843046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beafde-9edc-4184-a694-10740966d71f service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.848288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.849059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.849342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.849611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.850368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:10.850672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.851455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 950/1893] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:10.853143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.862600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.864427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:10.866847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 944/1894] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:10.871832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.880989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91bd241-e1bf-4612-8b8b-cc6177ab4b9b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.881955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd28009-9bcd-41df-9f3b-2cb1f570874f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:10.885360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.886227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.886668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.887082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.888903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:10.889639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:10.889934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:10.890247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:10.891566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.894034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.899177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:10.900638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:10.913102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 951/1895] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:36:10.931896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 945/1896] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:10 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:10.936407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:10.948661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7bbfbb-4b67-4b72-8183-f6c6b594efe7 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.001496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.029370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.030185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.030567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.030891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.031834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.033894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.050927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:11.063320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 952/1897] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:10 2022] POST /identity/v3/users => generated 287 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:11.064811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.072106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29823-af2e-4853-82d5-bf239108ce34 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.077285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.078296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.078702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.079314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.080157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e414af-c4ce-4869-b87c-799d796e937f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.082198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:11.086094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.087465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.087771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.088111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.088907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.090877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.103145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 953/1898] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:11.107603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.126157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97827890-4ea5-4819-b4c8-171ee01d3c15 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.135985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.136944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.137334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.137696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.138716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.140504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.153605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 954/1899] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:36:11.157728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.172409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.173936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd8025-a795-4cb4-8ac6-72f203b2b682 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.183234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc082789-41f2-43ae-b3d3-fe64bcbc2fea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.184781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 946/1900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:36:11.189214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.190235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.191035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.191035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] PATH_INFO: `/v3/projects/1041fe56a09f4640973a2e880902175c/users/96c2cc1a3cee4185bfea31207b070c19/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.212325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1041fe56a09f4640973a2e880902175c, user_id=96c2cc1a3cee4185bfea31207b070c19, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.215916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.263896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 955/1901] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:11 2022] PUT /identity/v3/projects/1041fe56a09f4640973a2e880902175c/users/96c2cc1a3cee4185bfea31207b070c19/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:11.265823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.266185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.266472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.315296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] MFA Rules not processed for user `96c2cc1a3cee4185bfea31207b070c19`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:11.316746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:11.442653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 947/1902] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:11.454476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.527658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eeae2-e831-4373-aa67-bd63f7d8b74b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.531440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.532117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.532383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.532653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.542605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.544063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a28ef51-32ef-404a-bfc4-be305aeb54ce service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.553317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 956/1903] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:11.573004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.582683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:11.644002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab07496-baf6-4a43-80e8-faed923ccba9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.649825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.651008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.651281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.651548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] PATH_INFO: `/v3/users/96c2cc1a3cee4185bfea31207b070c19` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.652821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96c2cc1a3cee4185bfea31207b070c19)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.654877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.718093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96c2cc1a3cee4185bfea31207b070c19'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:11.725911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96c2cc1a3cee4185bfea31207b070c19'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:11.726786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96c2cc1a3cee4185bfea31207b070c19'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:11.737536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96c2cc1a3cee4185bfea31207b070c19'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:11.738684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96c2cc1a3cee4185bfea31207b070c19'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:11.762360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 948/1904] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:11 2022] DELETE /identity/v3/users/96c2cc1a3cee4185bfea31207b070c19 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:11.768039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.768389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.768773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.786540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:11.787757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:11.848082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 957/1905] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:11.858516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:11.860133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:11.921407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fad41e-5763-418e-bd7f-0cc4a8617631 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:11.925297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:11.925973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:11.926278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:11.926551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:11.937016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:11.938515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4e665-8e12-4058-9b38-3a8703b52a0d service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:11.948494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 949/1906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:12.234046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.235734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:12.248229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a143ce5-fc90-40ee-9883-f796a3e138a5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.258873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.259954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.260300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.260641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] PATH_INFO: `/v3/projects/1041fe56a09f4640973a2e880902175c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.262032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1041fe56a09f4640973a2e880902175c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.264042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.324108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1041fe56a09f4640973a2e880902175c', 'request_id': 'req-42a1431e-26ca-4520-b39d-aec4d2f6fe83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:12.327100 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:12.335235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1041fe56a09f4640973a2e880902175c', 'request_id': 'req-42a1431e-26ca-4520-b39d-aec4d2f6fe83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:12.345622 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1041fe56a09f4640973a2e880902175c', 'request_id': 'req-42a1431e-26ca-4520-b39d-aec4d2f6fe83'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:12.361238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] The token cache is being invalidate because project 1041fe56a09f4640973a2e880902175c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:12.361400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:12.362017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-42a1431e-26ca-4520-b39d-aec4d2f6fe83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:12.363740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 958/1907] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:12 2022] DELETE /identity/v3/projects/1041fe56a09f4640973a2e880902175c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:12.369743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.370430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.370430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.390822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:12.392052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:12.420818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:12.478299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 950/1908] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:12.483603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.483892 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.484171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.509236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:12.510827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:12.523702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 959/1909] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:12.527874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.538100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de77da-d072-44d9-810c-cad15060fbba None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.543354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.544037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.544318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.544594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.545344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:12.545651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.547344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.560445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 951/1910] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:12.564881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.587233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d6c59-3589-42d8-8b7f-4f6d44a6c0d6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.595130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.598808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.599099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.599383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.600126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.602499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.631479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 960/1911] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:12 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:12.636082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.646133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01d1c1-ffce-46c2-ab4b-e483079da1d8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.705519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.706489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.706789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.707066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.707781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.709744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.736923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 952/1912] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:12 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:12.741278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.752208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe02958-2329-4d90-8617-f779f6e24b4c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.756883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.757717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.758040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.758420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.759163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.760795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.773162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 961/1913] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:12.777715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.788420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45063b80-913d-40c7-82e8-9318f642a64c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.793437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.794199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.794549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.794775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.795517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.797123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69a84b-374e-4cd8-bd5d-7964bd02fadc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.812444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 953/1914] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:36:12.813842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:12.824732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f108b-d29f-490c-ac80-d8dbf400cd68 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:12.830483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:12.832539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.833032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.833512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] PATH_INFO: `/v3/projects/ed30779fc9394bd4a5218d9c62abf7ac/users/53fe18ac03b1492daf5d1dfbf3a4302a/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.858182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed30779fc9394bd4a5218d9c62abf7ac, user_id=53fe18ac03b1492daf5d1dfbf3a4302a, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:12.861052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:12.876364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 962/1915] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:12 2022] PUT /identity/v3/projects/ed30779fc9394bd4a5218d9c62abf7ac/users/53fe18ac03b1492daf5d1dfbf3a4302a/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:12.886674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:12.886970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:12.887292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:12.916007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] MFA Rules not processed for user `53fe18ac03b1492daf5d1dfbf3a4302a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:12.917263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:12.991598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 954/1916] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:13.004883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:13.006688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:13.088253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43853e6c-b284-4c11-958a-27fcb35b0a9c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:13.092703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:13.093707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:13.094164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:13.094566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:13.107458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:13.109858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:13.121775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 963/1917] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:36:13.676821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:13.681103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:13.725003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:13.778159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6dc9-8854-4678-9d9c-cd987651b8a6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:13.785691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:13.786924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:13.787263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:13.787639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:13.790440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:13.888330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:13.892293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9691e-e091-436e-978e-9d2c49fb08d0 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:13.918099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 955/1918] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:15.989575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:15.991491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:16.064656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd2366-b18a-48ae-b907-c88dbc9600a9 service glance] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:16.069578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:16.070530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:16.070802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:16.071077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] PATH_INFO: `/v3/users/3db73ee7d44a41999ec9fe93add646ff` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:16.072328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db73ee7d44a41999ec9fe93add646ff)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:16.074359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:16.098322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:16.129155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db73ee7d44a41999ec9fe93add646ff'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.137124 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db73ee7d44a41999ec9fe93add646ff'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.150993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db73ee7d44a41999ec9fe93add646ff'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.151843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db73ee7d44a41999ec9fe93add646ff'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.159583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db73ee7d44a41999ec9fe93add646ff'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.166210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 964/1919] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:15 2022] DELETE /identity/v3/users/3db73ee7d44a41999ec9fe93add646ff => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:16.170926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:16.171567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:16.171567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:16.198672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:16.200041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:16.273890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 956/1920] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:16.281160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:16.282690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:16.354296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545055b2-5f78-4c31-bd60-d42f384abff0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:16.361299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:16.361968 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:16.362270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:16.362545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:16.373781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:16.375275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:16.387052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 965/1921] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:16.770433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:16.772160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:16.787688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f6c1d-2e2d-465f-84df-5b15c63cc598 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:16.794441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:16.795475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:16.795850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:16.796219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] PATH_INFO: `/v3/projects/d135e18c7b4248c399a4edf5c1bc29b7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:16.797692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d135e18c7b4248c399a4edf5c1bc29b7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:16.800422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:16.854730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd135e18c7b4248c399a4edf5c1bc29b7', 'request_id': 'req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.860368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd135e18c7b4248c399a4edf5c1bc29b7', 'request_id': 'req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.866760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd135e18c7b4248c399a4edf5c1bc29b7', 'request_id': 'req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.876967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:16.883411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] The token cache is being invalidate because project d135e18c7b4248c399a4edf5c1bc29b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:16.883767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.884426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:16.886485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 957/1922] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:16 2022] DELETE /identity/v3/projects/d135e18c7b4248c399a4edf5c1bc29b7 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:16.890878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:16.901855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc579d38-7cd1-4aa9-b1c6-09cb62f7e855 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:16.965757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:16.966570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:16.966852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:16.967122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] PATH_INFO: `/v3/users/c7af96ee869449d2ba6a9d8b53e80b6e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:16.968416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7af96ee869449d2ba6a9d8b53e80b6e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:16.970433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:17.022774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:17.025958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7af96ee869449d2ba6a9d8b53e80b6e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.035756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7af96ee869449d2ba6a9d8b53e80b6e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.050882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7af96ee869449d2ba6a9d8b53e80b6e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.051679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7af96ee869449d2ba6a9d8b53e80b6e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.060668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7af96ee869449d2ba6a9d8b53e80b6e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.067241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 966/1923] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:16 2022] DELETE /identity/v3/users/c7af96ee869449d2ba6a9d8b53e80b6e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:17.355795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:17.357266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:17.371452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45106d2d-3f7e-4511-ab7c-7c1e76a51bdb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:17.437521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:17.438437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:17.438726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:17.439000 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] PATH_INFO: `/v3/projects/e36068ea3ce1422986eafaf73bc7162c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:17.440271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e36068ea3ce1422986eafaf73bc7162c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:17.442238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:17.499687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e36068ea3ce1422986eafaf73bc7162c', 'request_id': 'req-90967a69-1da3-4e67-8d80-373265526c2c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.506126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e36068ea3ce1422986eafaf73bc7162c', 'request_id': 'req-90967a69-1da3-4e67-8d80-373265526c2c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.513369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e36068ea3ce1422986eafaf73bc7162c', 'request_id': 'req-90967a69-1da3-4e67-8d80-373265526c2c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.529276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] The token cache is being invalidate because project e36068ea3ce1422986eafaf73bc7162c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:17.529568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.530255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.532411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 958/1924] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:17 2022] DELETE /identity/v3/projects/e36068ea3ce1422986eafaf73bc7162c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:17.536255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:17.537763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:17.551349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f2b5fc-9743-4afd-ab9c-9d31d13226ae admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:17.620369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:17.621271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:17.621553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:17.621841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] PATH_INFO: `/v3/users/efccd6992b5543dcb31c7b3ce7004fc2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:17.623184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=efccd6992b5543dcb31c7b3ce7004fc2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:17.625137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:17.681816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efccd6992b5543dcb31c7b3ce7004fc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.693457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efccd6992b5543dcb31c7b3ce7004fc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.716097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efccd6992b5543dcb31c7b3ce7004fc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.716894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efccd6992b5543dcb31c7b3ce7004fc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.726686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-62ff5afa-b068-4445-b1b9-0550f5dc94ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efccd6992b5543dcb31c7b3ce7004fc2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:17.738104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 967/1925] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:17 2022] DELETE /identity/v3/users/efccd6992b5543dcb31c7b3ce7004fc2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:18.057348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.059213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:18.073254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90967a69-1da3-4e67-8d80-373265526c2c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.141061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.141889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.142200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.142475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] PATH_INFO: `/v3/projects/f734f1afdd6f4acda15c6dd5c0041366` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.143688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f734f1afdd6f4acda15c6dd5c0041366)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.145695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.184830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:18.202296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f734f1afdd6f4acda15c6dd5c0041366', 'request_id': 'req-c9ebb7e8-0c0f-4692-b811-98ed67e33990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:18.209809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f734f1afdd6f4acda15c6dd5c0041366', 'request_id': 'req-c9ebb7e8-0c0f-4692-b811-98ed67e33990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:18.218473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f734f1afdd6f4acda15c6dd5c0041366', 'request_id': 'req-c9ebb7e8-0c0f-4692-b811-98ed67e33990'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:18.241019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] The token cache is being invalidate because project f734f1afdd6f4acda15c6dd5c0041366 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:18.241316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:18.242118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c9ebb7e8-0c0f-4692-b811-98ed67e33990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:18.243896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 959/1926] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:18 2022] DELETE /identity/v3/projects/f734f1afdd6f4acda15c6dd5c0041366 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:18.250386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.250854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.251131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.271787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:18.272750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:18.315758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:18.351550 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 968/1927] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:18.362003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.362964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.362964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.383803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:18.385050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:18.394580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 960/1928] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:18.399371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.409693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd08540-1f4a-4300-916f-d6282543e8ad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.415109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.415794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.416070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.416338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.417071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:18.417375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.419032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.433029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 969/1929] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:18.437791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.447640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4f51b-427e-4e28-991a-018af415651e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.452807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.453485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.453757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.454029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.454835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.457134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.492183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 961/1930] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:18.499154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.511277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d28cd-bb8e-4eec-9cba-9ad4a785dce6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.586903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.587720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.588060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.588416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.589607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.593096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.627789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 970/1931] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:18.633726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.647124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b95e5d-9e48-4a31-912a-06c1f81b573f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.652446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.653219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.653702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.653811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.654541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.656209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.668584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 962/1932] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:18.673072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.684772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d407d1-ec50-416d-a9c5-2c2f7be817b3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.689913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.690653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.690933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.691208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.691956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.693865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1059df9-5e3d-4e47-8ce3-9e042d00a5f1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.705540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 971/1933] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:18.710619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.724162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887303d6-1428-4d7a-b000-bc94c12eb0db admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:18.729442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:18.730357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.730637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.730903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] PATH_INFO: `/v3/projects/7946e2369fe0449f97e300464deacc28/users/b141cb1c49bf4383b7b37966f05184f8/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.748576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7946e2369fe0449f97e300464deacc28, user_id=b141cb1c49bf4383b7b37966f05184f8, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:18.751414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:18.768387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 963/1934] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:18 2022] PUT /identity/v3/projects/7946e2369fe0449f97e300464deacc28/users/b141cb1c49bf4383b7b37966f05184f8/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:18.782428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:18.782840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:18.783224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:18.814586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] MFA Rules not processed for user `b141cb1c49bf4383b7b37966f05184f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:18.816205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:18.901452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 972/1935] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:18.905842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:18.998703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5fd1d4-2391-49af-8d70-231c1e7cc51a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.003454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.004277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.004481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.004684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.005394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.007474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.039053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 964/1936] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:18 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:19.047647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.061085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1316515a-9847-462f-84bc-32ff3f5acd98 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.103249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:19.148495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.149331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.149611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.149910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.150897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.152958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.176470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 973/1937] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:19 2022] POST /identity/v3/users => generated 297 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:19.181358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.192233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925efd2b-64fb-484c-bfd6-9fe99d349192 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.197727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.198468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.198753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.199030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.199792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.201506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.215264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 965/1938] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:19.220030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.231651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3eecb-f186-4864-ab66-22c130a95285 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.237574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.238725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.239098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.239509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] PATH_INFO: `/v3/projects/bba70650a8ef47539da467399aa77f0b/users/274c7317565d43d7bafd4be8bf91c314/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.259295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba70650a8ef47539da467399aa77f0b, user_id=274c7317565d43d7bafd4be8bf91c314, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.262707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.279953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 974/1939] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:19 2022] PUT /identity/v3/projects/bba70650a8ef47539da467399aa77f0b/users/274c7317565d43d7bafd4be8bf91c314/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:19.284217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.295779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64ad03-071c-4424-b81b-460e7acd1997 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.325986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:19.368184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.368853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.369130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.369402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.370168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.371800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3790c2b5-808f-40f5-9866-51bdbc841832 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.382676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 966/1940] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:19.387456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.397819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4d3222-5fba-4361-b545-3ad0df856c93 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.403244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.404143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.404420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.404692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] PATH_INFO: `/v3/projects/bba70650a8ef47539da467399aa77f0b/users/274c7317565d43d7bafd4be8bf91c314/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.406703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba70650a8ef47539da467399aa77f0b, user_id=274c7317565d43d7bafd4be8bf91c314, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.409350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.420585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 975/1941] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:19 2022] PUT /identity/v3/projects/bba70650a8ef47539da467399aa77f0b/users/274c7317565d43d7bafd4be8bf91c314/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:19.431133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.431392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.431679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.461731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] MFA Rules not processed for user `274c7317565d43d7bafd4be8bf91c314`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:19.463022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:19.542180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 967/1942] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:19.561787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.564350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:19.657330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da946b-6bbe-437f-96c1-5462b90d27ed admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.662011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.662711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.662989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.663263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.673966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.675503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7b873-e6ea-4748-8dfb-1e75b8ae3b45 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.686282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 976/1943] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:19.791190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:19.801409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4284e8ba-7689-49fc-a811-caf331f5a390 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:19.805456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:19.806316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:19.806598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:19.806873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:19.877792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:19.879307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6e62-2dc4-4b1a-a6bc-5ec285d3f884 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:19.894643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 968/1944] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:27.282350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:27.283338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:27.284864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:27.287538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 977/1945] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:36:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:36:27.295764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:27.296298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:27.296852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:27.331484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:27.333092 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:27.389880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:27.417965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 969/1946] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:36:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:27.432398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:27.434326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:27.453330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b780f-16b1-4f50-9e45-333bb4431c5d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:27.459596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:27.460265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:27.460584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:27.460852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:27.471116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:27.472713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:27.484133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 978/1947] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:27.791656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:27.794726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:27.903174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd72865-8739-4a4f-9ee1-fbd20e9308d6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:27.915576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:27.916582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:27.916961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:27.917335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] PATH_INFO: `/v3/users/87c5cf6658034dfc88f99c6dbd6c93dc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:27.918827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] RBAC: Authorizing `identity:delete_user(user_id=87c5cf6658034dfc88f99c6dbd6c93dc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:27.921287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:27.982463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:27.986934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87c5cf6658034dfc88f99c6dbd6c93dc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:27.998842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac0b90b-0654-4a79-9c48-e7c5b5cdbc6d service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:28.005418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:28.006349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:28.006652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:28.006921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87c5cf6658034dfc88f99c6dbd6c93dc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.007042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] PATH_INFO: `/v3/users/b141cb1c49bf4383b7b37966f05184f8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:28.007750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87c5cf6658034dfc88f99c6dbd6c93dc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.008305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b141cb1c49bf4383b7b37966f05184f8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:28.010606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:28.018171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87c5cf6658034dfc88f99c6dbd6c93dc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.019010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ca3d101e-4357-48db-a3a6-e189ec15527f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87c5cf6658034dfc88f99c6dbd6c93dc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.044951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 970/1948] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:27 2022] DELETE /identity/v3/users/87c5cf6658034dfc88f99c6dbd6c93dc => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:28.051710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:28.052063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:28.052345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:28.071381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b141cb1c49bf4383b7b37966f05184f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.074703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:28.076142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.081833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b141cb1c49bf4383b7b37966f05184f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.101071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b141cb1c49bf4383b7b37966f05184f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.102678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b141cb1c49bf4383b7b37966f05184f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.104831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:28.122503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-55f9a162-0eed-4890-a6b3-960a2c33aa16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b141cb1c49bf4383b7b37966f05184f8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:28.137707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 979/1949] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:27 2022] DELETE /identity/v3/users/b141cb1c49bf4383b7b37966f05184f8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:28.142759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:28.143215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:28.143365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:28.156105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:28.168219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:28.169970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 971/1950] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:28.170114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.181846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:28.187207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.253664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 980/1951] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:28.265312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:28.270254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.297594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7c739d-c89d-47f4-8618-cfdefb019ce4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:28.369747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a408a5f-64ac-4663-8f5b-0dde6ac551b0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:28.372696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:28.373375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:28.373667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:28.373940 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:28.374382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:28.375118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:28.375461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:28.375796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:28.385192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:28.385665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:28.386632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:28.387161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:28.400099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 981/1953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:36:28.400334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 972/1953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:28.972051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:28.973329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.979963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:28.981941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:28.993577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4b654-3bee-4661-80be-046ab18b8ceb service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.006344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.007404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.007623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.007900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] PATH_INFO: `/v3/projects/7946e2369fe0449f97e300464deacc28` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.009223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7946e2369fe0449f97e300464deacc28)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.011388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.020709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac23b18-d045-4093-bc50-2dc940e2c7c1 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.039566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.040548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.040897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.041179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] PATH_INFO: `/v3/projects/e66361c002ea4a138c58cf7b2429e613` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.042683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66361c002ea4a138c58cf7b2429e613)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.045783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.067543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7946e2369fe0449f97e300464deacc28', 'request_id': 'req-2ceed14a-c809-4040-ac14-e3a0e385de92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.083365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7946e2369fe0449f97e300464deacc28', 'request_id': 'req-2ceed14a-c809-4040-ac14-e3a0e385de92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.091617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7946e2369fe0449f97e300464deacc28', 'request_id': 'req-2ceed14a-c809-4040-ac14-e3a0e385de92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.105148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66361c002ea4a138c58cf7b2429e613', 'request_id': 'req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.105922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] The token cache is being invalidate because project 7946e2369fe0449f97e300464deacc28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:29.106278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.106931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.108905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 982/1954] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:28 2022] DELETE /identity/v3/projects/7946e2369fe0449f97e300464deacc28 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:29.112917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:29.114363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66361c002ea4a138c58cf7b2429e613', 'request_id': 'req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.114660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:29.122662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66361c002ea4a138c58cf7b2429e613', 'request_id': 'req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.144485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:29.150808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] The token cache is being invalidate because project e66361c002ea4a138c58cf7b2429e613 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:29.151678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.152469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.157604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 973/1955] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:28 2022] DELETE /identity/v3/projects/e66361c002ea4a138c58cf7b2429e613 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:29.159272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:29.161499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:29.204449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceed14a-c809-4040-ac14-e3a0e385de92 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.222579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:29.250080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a6de6-1fbb-4ae9-bc17-8c1565a22d69 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.251447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.252433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.252811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.253158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] PATH_INFO: `/v3/users/623b00f26a9b4b92b4894199035ebb34` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.259199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623b00f26a9b4b92b4894199035ebb34)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.262190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.269608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.270541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.270829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.271105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] PATH_INFO: `/v3/users/274c7317565d43d7bafd4be8bf91c314` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.272506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274c7317565d43d7bafd4be8bf91c314)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.274616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.322895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623b00f26a9b4b92b4894199035ebb34'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.330527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623b00f26a9b4b92b4894199035ebb34'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.331810 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623b00f26a9b4b92b4894199035ebb34'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.332765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274c7317565d43d7bafd4be8bf91c314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.342762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274c7317565d43d7bafd4be8bf91c314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.347398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623b00f26a9b4b92b4894199035ebb34'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.348535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623b00f26a9b4b92b4894199035ebb34'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.358537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274c7317565d43d7bafd4be8bf91c314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.359314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274c7317565d43d7bafd4be8bf91c314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.369507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274c7317565d43d7bafd4be8bf91c314'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.376221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 974/1956] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:29 2022] DELETE /identity/v3/users/623b00f26a9b4b92b4894199035ebb34 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:29.378137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 983/1957] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:29 2022] DELETE /identity/v3/users/274c7317565d43d7bafd4be8bf91c314 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:29.710269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:29.712392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:29.808132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:29.810542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:29.814575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e2ceb-43cf-4ae8-8152-be70cb852497 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.876726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:29.897854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.899562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5abcc2-6719-40dc-8258-43100b1d92e7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:29.899967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.900431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.901007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] PATH_INFO: `/v3/projects/bba70650a8ef47539da467399aa77f0b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.902689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba70650a8ef47539da467399aa77f0b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.905179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:29.906077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:29.906444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:29.906545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.906831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] PATH_INFO: `/v3/projects/203169f572ab427b836f7ef773197ff3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:29.908474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] RBAC: Authorizing `identity:delete_project(project_id=203169f572ab427b836f7ef773197ff3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:29.910542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:29.918887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:29.966919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba70650a8ef47539da467399aa77f0b', 'request_id': 'req-538abfe3-0c72-4a58-add8-c5aa37ce0aee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.973066 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba70650a8ef47539da467399aa77f0b', 'request_id': 'req-538abfe3-0c72-4a58-add8-c5aa37ce0aee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.973664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '203169f572ab427b836f7ef773197ff3', 'request_id': 'req-afa28756-6137-4f61-8aeb-4b9f19a56774'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.979712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba70650a8ef47539da467399aa77f0b', 'request_id': 'req-538abfe3-0c72-4a58-add8-c5aa37ce0aee'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.986760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '203169f572ab427b836f7ef773197ff3', 'request_id': 'req-afa28756-6137-4f61-8aeb-4b9f19a56774'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.994934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '203169f572ab427b836f7ef773197ff3', 'request_id': 'req-afa28756-6137-4f61-8aeb-4b9f19a56774'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.997237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] The token cache is being invalidate because project bba70650a8ef47539da467399aa77f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:29.997739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:29.998622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-538abfe3-0c72-4a58-add8-c5aa37ce0aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:30.000675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 975/1958] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:29 2022] DELETE /identity/v3/projects/bba70650a8ef47539da467399aa77f0b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:30.005627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb236-c6ef-4a7b-bb06-10a3a0a6c9c2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.005916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb236-c6ef-4a7b-bb06-10a3a0a6c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.006236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470cb236-c6ef-4a7b-bb06-10a3a0a6c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.008270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] The token cache is being invalidate because project 203169f572ab427b836f7ef773197ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:30.009065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:30.009345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-afa28756-6137-4f61-8aeb-4b9f19a56774 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:30.010956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 984/1959] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:29 2022] DELETE /identity/v3/projects/203169f572ab427b836f7ef773197ff3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:30.015629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b858-0451-4c9c-ab0b-39bface14442 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.015912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b858-0451-4c9c-ab0b-39bface14442 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.016186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2167b858-0451-4c9c-ab0b-39bface14442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.029628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-470cb236-c6ef-4a7b-bb06-10a3a0a6c9c2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.031187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-470cb236-c6ef-4a7b-bb06-10a3a0a6c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.041650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2167b858-0451-4c9c-ab0b-39bface14442 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.042924 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2167b858-0451-4c9c-ab0b-39bface14442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.104332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 976/1960] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:30.113491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.113779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.114073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.115867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 985/1961] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:30.123745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.124121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.124475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.134595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.135817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.143529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.144310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 977/1962] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:30.144802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.148626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.153359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 986/1963] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:30.157913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.159723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6d44af-d267-4e1f-be25-b1c440cf1515 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.166703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.167402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.167685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.167961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.168604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac90507c-0a03-4ac6-870c-1a837c80e7be None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.168726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:30.169003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.170788 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.173194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.173858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.174173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.174452 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.175177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:30.175486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.177101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.183535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 978/1964] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:36:30.188257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.189475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 987/1965] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:36:30.193813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.198677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e2a8c8-0142-45ab-9f9b-1403d49ead64 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.203695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.204180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e811bb0-c34f-480a-9212-9990f2d089d9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.204396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.204700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.204976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.205701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.209522 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.214157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.215325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.215865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.216241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.217086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.219940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.241019 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 979/1966] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:30.246608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.260693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 988/1967] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:30.274317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.319976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:30.341904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:30.347065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7f6e2-f915-4675-9d79-7560c577cb7b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.364294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53775c0-3932-464b-b555-24c0c069338e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.375545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.376566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.376847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.377122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.377835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.379853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.410064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 989/1968] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/users => generated 290 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:30.411154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.422248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c052841b-0089-4163-9caa-9213b59dcc46 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.423392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.424879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.425336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.425801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.426999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.429753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.433794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.434654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.434944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.435223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.436022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.437660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.450437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 990/1969] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:30.454183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.464458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 980/1970] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:36:30.468734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.470741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a577a-863c-4344-946a-5413c5a9e0b0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.477252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.478105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.478478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.478866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.479723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.480291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be456127-ef36-4f40-bf54-1298b076ef5f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.481613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.485267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.486457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.486818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.487198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.488285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.489893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.494038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 991/1971] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:36:30.498178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.505135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 981/1972] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:36:30.508853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00c37b-fc46-4e70-9b1b-e95e6f4ca56f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.509461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.514331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.515272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.515557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.515834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] PATH_INFO: `/v3/projects/86abc34429524f27bf8d7ac1874c9e38/users/ff5e137596544eec9e96bb199fedcb9d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.520593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad623dbb-a196-4273-a83f-fe0ceb81746e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.526216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.526955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.527241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.527512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.528250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.529895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.535939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86abc34429524f27bf8d7ac1874c9e38, user_id=ff5e137596544eec9e96bb199fedcb9d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.538834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3879180-32cf-43c7-961c-292456b2c2a2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.550388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 982/1973] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:30.554540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 992/1974] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:30 2022] PUT /identity/v3/projects/86abc34429524f27bf8d7ac1874c9e38/users/ff5e137596544eec9e96bb199fedcb9d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:30.559109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.567257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.567554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.567810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.569756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1373b4-6a41-4eac-bb06-b64ade7a9da7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.597972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] MFA Rules not processed for user `ff5e137596544eec9e96bb199fedcb9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.599168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.636672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.637662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.637922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.638361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] PATH_INFO: `/v3/projects/1d839777f6d64e0bb2963484e6f87f89/users/11043d9bd6084e2b8ecd8866351f78c6/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.657088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d839777f6d64e0bb2963484e6f87f89, user_id=11043d9bd6084e2b8ecd8866351f78c6, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.660512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa496b-8999-4b5d-92d5-1a38a673b01a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.676871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 993/1975] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:30.677081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 983/1976] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:30 2022] PUT /identity/v3/projects/1d839777f6d64e0bb2963484e6f87f89/users/11043d9bd6084e2b8ecd8866351f78c6/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:30.683176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.687033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.687417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.688499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.695596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9178c-69d5-482d-9ddf-5db87914aab2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.720829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] MFA Rules not processed for user `11043d9bd6084e2b8ecd8866351f78c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:30.722368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.767490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.768338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.768692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.769031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.769776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.771753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.772613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:30.781852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:30.803745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 984/1977] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:30.804711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 994/1978] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:30.809834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.815981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.817977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:30.823290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf07a64-8dd1-428f-ad84-c26e017239ac None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.880018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305d538-1e36-4eeb-a086-928a038de72a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.881081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.881779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.882157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.882436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.883213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.884607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.885161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.885290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.885573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.885938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.916836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 985/1979] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:30 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:30.918158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.932159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21048ac0-1975-420c-a711-c2298b22a0a5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.938498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.939365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.939827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.940033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.940755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.942446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.955021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:30.956725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 986/1980] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:30.957078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:30.960874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:30.967807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 995/1981] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:30.973006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc46cdf-09a5-4a5d-986a-ea3c4bea1ac1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:30.979084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:30.980109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:30.980477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:30.980803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] PATH_INFO: `/v3/projects/fa31e0327bda473194b84f5b0d58e924/users/3ba6228f6a4442638ca6e242a9445930/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:30.998546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa31e0327bda473194b84f5b0d58e924, user_id=3ba6228f6a4442638ca6e242a9445930, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:31.001837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:31.026924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 987/1982] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:30 2022] PUT /identity/v3/projects/fa31e0327bda473194b84f5b0d58e924/users/3ba6228f6a4442638ca6e242a9445930/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:31.032468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:31.045410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8078f564-42a8-40db-86ff-e15b1d99c617 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:31.132247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:31.132824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:31.133257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:31.133451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:31.134253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:31.135941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73518e-433d-4d28-af0a-02b81b431961 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:31.151344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 996/1983] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:31.156091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:31.168767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edf8e5-55e9-4107-a7ad-c9175bf5531f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:31.174524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:31.175701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:31.176046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:31.176520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] PATH_INFO: `/v3/projects/fa31e0327bda473194b84f5b0d58e924/users/3ba6228f6a4442638ca6e242a9445930/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:31.178597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa31e0327bda473194b84f5b0d58e924, user_id=3ba6228f6a4442638ca6e242a9445930, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:31.181446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:31.193036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 988/1984] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:31 2022] PUT /identity/v3/projects/fa31e0327bda473194b84f5b0d58e924/users/3ba6228f6a4442638ca6e242a9445930/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:31.204006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:31.204299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:31.204581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:31.238749 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] MFA Rules not processed for user `3ba6228f6a4442638ca6e242a9445930`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:31.240063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:31.286038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:31.337783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 997/1985] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:31.353616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:31.411635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a180d-04d3-4fab-8be8-9e08a1743d0e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:31.415869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:31.416551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:31.416837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:31.417111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:31.428462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:31.429883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b88ae2a-ff5f-42b2-8aca-7b19d0affabf service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:31.441710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 989/1986] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:31.909565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:31.984732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafc1a5-5fef-4c16-9401-5a13856f183f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:31.989516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:31.990463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:31.990765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:31.991156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] PATH_INFO: `/v3/users/ff5e137596544eec9e96bb199fedcb9d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:31.992540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff5e137596544eec9e96bb199fedcb9d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:31.994555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:32.050175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff5e137596544eec9e96bb199fedcb9d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.059684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff5e137596544eec9e96bb199fedcb9d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.079294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff5e137596544eec9e96bb199fedcb9d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.079294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff5e137596544eec9e96bb199fedcb9d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.082198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff5e137596544eec9e96bb199fedcb9d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.089744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 998/1987] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:31 2022] DELETE /identity/v3/users/ff5e137596544eec9e96bb199fedcb9d => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:32.094470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:32.094757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:32.095030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:32.113713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:32.114951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:32.140709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:32.178929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 990/1988] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:32.188802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:32.190192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:32.243885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:32.259275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1129ef1-99b0-475b-9106-2f646cd53984 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:32.263465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:32.264147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:32.264437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:32.265153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:32.276201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:32.277606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:32.288659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 999/1989] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:32.584114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:32.586624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:32.599325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392d55-ea2d-45ec-9e42-2ceff488d04a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:32.605448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:32.606380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:32.606697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:32.606989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] PATH_INFO: `/v3/projects/86abc34429524f27bf8d7ac1874c9e38` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:32.608187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86abc34429524f27bf8d7ac1874c9e38)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:32.610226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:32.679508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86abc34429524f27bf8d7ac1874c9e38', 'request_id': 'req-f0efc993-bfb9-428f-a974-13f8bb0df7e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.687281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86abc34429524f27bf8d7ac1874c9e38', 'request_id': 'req-f0efc993-bfb9-428f-a974-13f8bb0df7e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.694528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86abc34429524f27bf8d7ac1874c9e38', 'request_id': 'req-f0efc993-bfb9-428f-a974-13f8bb0df7e3'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.713549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] The token cache is being invalidate because project 86abc34429524f27bf8d7ac1874c9e38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:32.713843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.714622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.716420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 991/1990] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:32 2022] DELETE /identity/v3/projects/86abc34429524f27bf8d7ac1874c9e38 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:32.720527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:32.731186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a7ec5-2af3-46c4-b709-90e415644a83 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:32.790161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:32.791150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:32.791506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:32.791791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] PATH_INFO: `/v3/users/3ba6228f6a4442638ca6e242a9445930` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:32.793024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ba6228f6a4442638ca6e242a9445930)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:32.795171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:32.847455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ba6228f6a4442638ca6e242a9445930'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.855109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ba6228f6a4442638ca6e242a9445930'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.869213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ba6228f6a4442638ca6e242a9445930'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.869902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ba6228f6a4442638ca6e242a9445930'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.876874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d7176199-9275-4728-bbd3-839871e393d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ba6228f6a4442638ca6e242a9445930'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:32.882829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1000/1991] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:32 2022] DELETE /identity/v3/users/3ba6228f6a4442638ca6e242a9445930 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:33.253760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.261756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:33.281284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efc993-bfb9-428f-a974-13f8bb0df7e3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.347582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.348721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.348991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.349381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] PATH_INFO: `/v3/projects/fa31e0327bda473194b84f5b0d58e924` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.350532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa31e0327bda473194b84f5b0d58e924)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.353395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.419706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa31e0327bda473194b84f5b0d58e924', 'request_id': 'req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:33.424611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:33.429202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa31e0327bda473194b84f5b0d58e924', 'request_id': 'req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:33.437449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa31e0327bda473194b84f5b0d58e924', 'request_id': 'req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:33.452269 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] The token cache is being invalidate because project fa31e0327bda473194b84f5b0d58e924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:33.452677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:33.453346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3ce6f6e4-8d9a-41bb-9beb-e4c1bf1fd0fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:33.458306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 992/1992] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:33 2022] DELETE /identity/v3/projects/fa31e0327bda473194b84f5b0d58e924 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:33.464155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.464611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.464792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.483145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:33.484278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:33.547744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1001/1993] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:33.558394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.558686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.558969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.578216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:33.579437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:33.589945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 993/1994] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:33.594399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.604653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52b9ef-4cf3-4c65-8f40-dbf577dc8775 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.609555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.610261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.610619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.610900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.611630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:33.611938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.613560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.615220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:33.627988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1002/1995] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:33.632543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.642477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ff224-ded2-4114-8fe3-9bcca71f7d49 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.647386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.648054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.648334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.648676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.649500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.651488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.679383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 994/1996] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:33 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:33.683706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.694684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996ee885-f4a2-4207-9391-f6967b4b4a01 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.765688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.766475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.766761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.767020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.767837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.769819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.792215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1003/1997] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:33 2022] POST /identity/v3/users => generated 287 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:33.796495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.807248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb7de8-c97f-45a9-9f56-84845c8b7b5b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.812124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.812834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.813105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.813383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.814125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.815785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.829544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 995/1998] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:36:33.834717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.845698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b31acf-2079-42a5-b15a-3894d48ab74a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.851009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.851780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.852915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.853199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.853943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.855626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92453ec-aa56-4874-8d6a-5d1d39d66175 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.866333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1004/1999] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:33.871085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:33.881286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27b1bf8-6831-4201-a68b-785e0b3fba93 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:33.886837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:33.887748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.888042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.888315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] PATH_INFO: `/v3/projects/9dbdd0dde2204b1b86957a070147f5d5/users/915c9c2be9b444219a718494ecd72449/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.906042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dbdd0dde2204b1b86957a070147f5d5, user_id=915c9c2be9b444219a718494ecd72449, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:33.908755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:33.924328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 996/2000] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:33 2022] PUT /identity/v3/projects/9dbdd0dde2204b1b86957a070147f5d5/users/915c9c2be9b444219a718494ecd72449/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:36:33.936011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:33.936304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:33.936574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:33.968656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] MFA Rules not processed for user `915c9c2be9b444219a718494ecd72449`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:33.969918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:34.044922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1005/2001] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:34.057200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:34.059348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:34.125332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4bcca-095f-40e0-8561-64a0f622b8bb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:34.129328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:34.129986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:34.130290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:34.130562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:34.140924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:34.142583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78f594-d507-41b8-b20d-120a56e61c8a service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:34.152854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 997/2002] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:34.180414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:34.260049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ec408-0122-4a10-90d6-f7d522d5d52d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:34.269708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:34.271151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:34.271783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:34.272198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] PATH_INFO: `/v3/users/915c9c2be9b444219a718494ecd72449` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:34.274543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] RBAC: Authorizing `identity:delete_user(user_id=915c9c2be9b444219a718494ecd72449)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:34.278636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:34.285270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:34.374836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915c9c2be9b444219a718494ecd72449'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:34.383748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915c9c2be9b444219a718494ecd72449'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:34.396405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915c9c2be9b444219a718494ecd72449'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:34.397125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915c9c2be9b444219a718494ecd72449'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:34.405808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915c9c2be9b444219a718494ecd72449'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:34.412281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1006/2003] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:36:34 2022] DELETE /identity/v3/users/915c9c2be9b444219a718494ecd72449 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:34.418235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:34.418235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:34.418235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:34.437402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:34.438669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:34.532902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 998/2004] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:36:34.545221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:34.546858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:34.646853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75771154-2b14-4d4c-af0f-19c1de1ad24e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:34.657142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:34.658112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:34.658697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:34.658887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:34.677471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:34.680838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b53654-b6b8-4f9c-923a-baca76e7fda5 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:34.700236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1007/2005] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:35.056656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.058320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:35.073014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9de28-a77f-4830-8e60-37d345b19569 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.079698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.081387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.081830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.082274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] PATH_INFO: `/v3/projects/9dbdd0dde2204b1b86957a070147f5d5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.083748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dbdd0dde2204b1b86957a070147f5d5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.085875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.134023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:35.186542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dbdd0dde2204b1b86957a070147f5d5', 'request_id': 'req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:35.198719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dbdd0dde2204b1b86957a070147f5d5', 'request_id': 'req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:35.218021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dbdd0dde2204b1b86957a070147f5d5', 'request_id': 'req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:35.233572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] The token cache is being invalidate because project 9dbdd0dde2204b1b86957a070147f5d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:36:35.233673 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:35.234303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7e2a8af-e43e-49e2-83d2-7a80ecb58f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:36:35.235907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 999/2006] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:36:35 2022] DELETE /identity/v3/projects/9dbdd0dde2204b1b86957a070147f5d5 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:35.241419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.241957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.243636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.269077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:35.270437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:35.344494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1008/2007] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:35.352527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.352899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.353511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.375539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:35.376769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:35.385755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1000/2008] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:35.390486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.401937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3245ae92-0ada-43b7-913c-17f92768f32b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.407850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.408524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.409243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.409243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.410035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:36:35.410537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.412417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.427736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1009/2009] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:36:35.432498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.442400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a967fa-57b5-4e93-bd18-3dc1c011e876 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.448062 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.449110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.449575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.450060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.453127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.457444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.505757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1001/2010] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:36:35 2022] POST /identity/v3/projects => generated 375 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:35.514302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.526910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7c684d-e4a3-4754-9935-b06f3f41cb7d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.534960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:35.600926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.601708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.602188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.602502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.603591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.605205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.628611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1010/2011] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:36:35 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:36:35.632972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.644209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80072f-72b6-43f1-a34f-4e80014d1b68 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.649427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.650123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.650404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.650744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.651667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.653321 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.664506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1002/2012] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:35.669101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.679628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea1e4b-af91-4a65-be57-f0a9da9dbb63 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.687243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.687967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.688329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.688606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.689409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.691028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb0d7c8-d6e4-43b5-ae42-9c2e06751e05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.702542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1011/2013] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:36:35.707757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.719623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed72e6-99d2-4bc8-b4b0-797ff5fcee17 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:35.725088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:35.725994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.726306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.726583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] PATH_INFO: `/v3/projects/88cf21437d914065b249accaa7963df0/users/f7559a8dbe074d4db55e357a6e06205e/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.750943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=88cf21437d914065b249accaa7963df0, user_id=f7559a8dbe074d4db55e357a6e06205e, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:35.754656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:35.772249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1003/2014] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:36:35 2022] PUT /identity/v3/projects/88cf21437d914065b249accaa7963df0/users/f7559a8dbe074d4db55e357a6e06205e/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:36:35.783720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:35.784198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:35.784663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:35.831981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] MFA Rules not processed for user `f7559a8dbe074d4db55e357a6e06205e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:36:35.833420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:35.921930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1012/2015] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:36:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:36:35.936245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:36:35.938918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:36:36.018988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47609c58-f236-43f6-9f27-3edd1f9de56e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:36:36.022901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:36:36.024261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:36:36.024261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:36:36.024261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:36:36.034077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:36:36.035747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d03fb8c-cbeb-4584-9881-d7a98515024e service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:36:36.047684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1004/2016] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:36:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:36:45.918270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=61,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:36:46.041413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:12.487256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:12.489525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:12.632251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50aa9e9-4374-4fdc-bd20-89f7cbfe457f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:12.640718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:12.642404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:12.642901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:12.643393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] PATH_INFO: `/v3/users/85f464dbb50c4974baeb17bbf3766c1e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:12.646036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85f464dbb50c4974baeb17bbf3766c1e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:12.650031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:12.735682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85f464dbb50c4974baeb17bbf3766c1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:12.747987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85f464dbb50c4974baeb17bbf3766c1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:12.768777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85f464dbb50c4974baeb17bbf3766c1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:12.769597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85f464dbb50c4974baeb17bbf3766c1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:12.782673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85f464dbb50c4974baeb17bbf3766c1e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:12.792571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1013/2017] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:12 2022] DELETE /identity/v3/users/85f464dbb50c4974baeb17bbf3766c1e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:12.798023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:12.799048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:12.799048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:12.821147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:12.822813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:12.931762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1005/2018] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:12.943848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:12.946594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:13.054701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961be846-1b18-458c-958d-b3dfd821bf11 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:13.061732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:13.063688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:13.063688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:13.063688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:13.088743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:13.090392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:13.109335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1014/2019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:13.683526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:13.685103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:13.700601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cf646-5440-4b11-831c-7c1eb6790e53 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:13.709258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:13.710796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:13.711481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:13.712178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] PATH_INFO: `/v3/projects/38f0d0f281ee4b609a47bf1ce29bf4c0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:13.714401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f0d0f281ee4b609a47bf1ce29bf4c0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:13.717797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:13.796874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f0d0f281ee4b609a47bf1ce29bf4c0', 'request_id': 'req-43807e9f-4a88-4941-9f17-cbdebfd4afe6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:13.804921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f0d0f281ee4b609a47bf1ce29bf4c0', 'request_id': 'req-43807e9f-4a88-4941-9f17-cbdebfd4afe6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:13.818643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f0d0f281ee4b609a47bf1ce29bf4c0', 'request_id': 'req-43807e9f-4a88-4941-9f17-cbdebfd4afe6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:13.849954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] The token cache is being invalidate because project 38f0d0f281ee4b609a47bf1ce29bf4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:13.850431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:13.851541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:13.854627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1006/2020] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:13 2022] DELETE /identity/v3/projects/38f0d0f281ee4b609a47bf1ce29bf4c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:13.859043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:13.870478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b1aca-aae5-4b65-bab4-6d9c17b9f6e1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:13.892575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:13.950390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:13.951320 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:13.951599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:13.951875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] PATH_INFO: `/v3/users/1af903050a824828a796f3cbd88d849e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:13.953206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af903050a824828a796f3cbd88d849e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:13.955611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:14.028601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af903050a824828a796f3cbd88d849e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:14.041859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af903050a824828a796f3cbd88d849e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:14.061409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af903050a824828a796f3cbd88d849e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:14.062315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af903050a824828a796f3cbd88d849e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:14.072045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-aec3af71-7ef7-4fd4-b2e6-b168f73eab11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af903050a824828a796f3cbd88d849e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:14.080299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1015/2021] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:13 2022] DELETE /identity/v3/users/1af903050a824828a796f3cbd88d849e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:14.812225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:14.815152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:14.840361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43807e9f-4a88-4941-9f17-cbdebfd4afe6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:14.928599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:14.929806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:14.930295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:14.930629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] PATH_INFO: `/v3/projects/274121763c9b45ccbe23d281b967113f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:14.932017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274121763c9b45ccbe23d281b967113f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:14.934044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:14.975391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:15.002611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274121763c9b45ccbe23d281b967113f', 'request_id': 'req-7c17c51e-9483-4451-b4af-2e5c4c8ee644'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:15.013334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274121763c9b45ccbe23d281b967113f', 'request_id': 'req-7c17c51e-9483-4451-b4af-2e5c4c8ee644'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:15.021530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274121763c9b45ccbe23d281b967113f', 'request_id': 'req-7c17c51e-9483-4451-b4af-2e5c4c8ee644'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:15.038974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] The token cache is being invalidate because project 274121763c9b45ccbe23d281b967113f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:15.039761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:15.040613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7c17c51e-9483-4451-b4af-2e5c4c8ee644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:15.042355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1007/2022] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:14 2022] DELETE /identity/v3/projects/274121763c9b45ccbe23d281b967113f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:15.053056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.054289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.054289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.081975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:15.083723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:15.168601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1016/2023] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:15.177784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.178167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.178482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.208890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:15.211139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:15.226572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1008/2024] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:15.231025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.243586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7a3f8-2a02-4757-bf31-d18f5393b95c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.250927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.251920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.252390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.252852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.258984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:15.260291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.264490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.288701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1017/2025] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:15.294651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.307240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716bea70-c598-4d9e-9191-2e12bab37c4c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.312958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.313806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.314285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.314700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.315644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.317870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.399990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1009/2026] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:15.407661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.427013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64ddc7-73c5-4621-838e-46efa231b7b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.517547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:15.573490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.576180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.576653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.577110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.578484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.584227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.649597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1018/2027] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:15.655364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.669384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bdfd4-db98-4908-b6a3-28ca86fb31ca admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.674786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.675600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.675878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.676177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.676942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.678670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.692236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1010/2028] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:15.696848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.711414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae4ebbd-1da1-4753-97c7-3011f8d44fea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.716716 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.717613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.717895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.718196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.718956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.720624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4feccc-751f-4f48-9c88-d050b32666ba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.733145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1019/2029] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:15.739428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:15.750535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54013f80-82f3-4ea1-bee6-946283fa9644 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:15.755706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:15.756639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.756922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.757581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] PATH_INFO: `/v3/projects/035f4b9cabce4e448497989b1d5273f2/users/8525df9d186147668dcfab32d44eff8d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.775677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=035f4b9cabce4e448497989b1d5273f2, user_id=8525df9d186147668dcfab32d44eff8d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:15.778938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:15.796141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1011/2030] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:15 2022] PUT /identity/v3/projects/035f4b9cabce4e448497989b1d5273f2/users/8525df9d186147668dcfab32d44eff8d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:15.814636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:15.814951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:15.815202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:15.852817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] MFA Rules not processed for user `8525df9d186147668dcfab32d44eff8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:15.854339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:15.935548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1020/2031] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:15.940345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.045101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d9313-c8c4-44f6-b584-4c3ddcbff7bb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.051069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.051819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.052226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.052550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.053373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.057853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.098275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1012/2032] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:15 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:16.103128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.120514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663058f3-9a4a-4864-8206-fa6e01a92b7e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.200503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.201338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.201827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.202192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.203104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.205704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.232116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1021/2033] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:16 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:16.237856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.249871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c30f5-5cbd-440d-8a9f-fdba4cdc9287 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.256018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.256807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.257245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.257648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.258607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.260547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.277331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1013/2034] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:16.283148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.302333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b141a29-d8db-4812-8ff8-9037f9282996 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.311696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.312773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.313203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.313645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.314930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.318391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db01f5-4cbf-4a37-aeb3-4cb83a8a0aab admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.339108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1022/2035] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:16.345308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.362457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39f4fb-84ae-4e09-8b8d-14c01a7cf044 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.370204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.371840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.372267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.372679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] PATH_INFO: `/v3/projects/d7a332433f7d4b239c54db4eaeeae1fe/users/4fa60fa0079a4a7a8bcfc2499086f80d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.396324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a332433f7d4b239c54db4eaeeae1fe, user_id=4fa60fa0079a4a7a8bcfc2499086f80d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.399455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.411300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:16.419543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1014/2036] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:16 2022] PUT /identity/v3/projects/d7a332433f7d4b239c54db4eaeeae1fe/users/4fa60fa0079a4a7a8bcfc2499086f80d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:16.432127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.432451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.432713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.465255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] MFA Rules not processed for user `4fa60fa0079a4a7a8bcfc2499086f80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:16.466802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:16.472027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:16.620854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1023/2037] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:16.623070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.746430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f9c56-a4b5-42d9-b0b2-22a5dec61912 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.758105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.758749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.759398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.760091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.761307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.764648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:16.803417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1015/2038] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:16 2022] POST /identity/v3/projects => generated 379 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:16.811012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:16.831286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fcbada-6500-4563-aabf-1c49a55ea1cf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:16.959625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:16.960785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:16.961270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:16.961781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:16.963070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:16.966546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.003065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1024/2039] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:16 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:17.005301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.018986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e28c1-e6eb-4520-a5a0-dfcb68ce2ef2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.025484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.026632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.026964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.027471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.028316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.030126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.044241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1016/2040] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:17.049150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.069431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25befb21-e061-4e8c-b074-347fd343a7f2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.077692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.079689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.080400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.080883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] PATH_INFO: `/v3/projects/930268fd9c6f411ba7d67a93c288bb59/users/f1a0eb50ae1c4cf6b15825af03e06b74/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.110473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930268fd9c6f411ba7d67a93c288bb59, user_id=f1a0eb50ae1c4cf6b15825af03e06b74, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.117065 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.142748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1025/2041] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:17 2022] PUT /identity/v3/projects/930268fd9c6f411ba7d67a93c288bb59/users/f1a0eb50ae1c4cf6b15825af03e06b74/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:17.148753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.162308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e67b0-7f2e-4244-909e-157b309a2216 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.253162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.253990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.259297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.259297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.259297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.259297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb979c-2263-4266-96a3-836d691213b9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.283530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1017/2042] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:17.289029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.302900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b9ec2-b310-4169-b65a-eb76fc1bdf80 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.310997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.312577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.312860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.313365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] PATH_INFO: `/v3/projects/930268fd9c6f411ba7d67a93c288bb59/users/f1a0eb50ae1c4cf6b15825af03e06b74/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.316093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=930268fd9c6f411ba7d67a93c288bb59, user_id=f1a0eb50ae1c4cf6b15825af03e06b74, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.322640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.339299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1026/2043] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:17 2022] PUT /identity/v3/projects/930268fd9c6f411ba7d67a93c288bb59/users/f1a0eb50ae1c4cf6b15825af03e06b74/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:17.356565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.356978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.357355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.399761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] MFA Rules not processed for user `f1a0eb50ae1c4cf6b15825af03e06b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:17.401793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:17.490790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:17.504960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1018/2044] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:17.517573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.519873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:17.595385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67d795-e63d-41fb-8836-5a1e7892aa75 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.601821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.603005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.603493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.603980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.621662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.624478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.634811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:17.645161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1027/2045] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:17.702779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:17.723685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc5eff-8546-4f78-bdf5-b6b7f5bfd266 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:17.723685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:17.723685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:17.724172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:17.724327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:17.833911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:17.837830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76edf8-e388-496e-969b-4b74331da373 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:17.856976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1019/2046] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:17 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:23.080982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:23.085408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:23.236906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399ced8-1902-47c5-86bb-9d7dc25b2323 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:23.243007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:23.244083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:23.244364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:23.244842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] PATH_INFO: `/v3/users/53fe18ac03b1492daf5d1dfbf3a4302a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:23.246620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fe18ac03b1492daf5d1dfbf3a4302a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:23.248816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:23.351054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fe18ac03b1492daf5d1dfbf3a4302a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:23.362634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fe18ac03b1492daf5d1dfbf3a4302a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:23.380862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fe18ac03b1492daf5d1dfbf3a4302a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:23.383155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fe18ac03b1492daf5d1dfbf3a4302a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:23.393496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fe18ac03b1492daf5d1dfbf3a4302a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:23.401879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1028/2047] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:23 2022] DELETE /identity/v3/users/53fe18ac03b1492daf5d1dfbf3a4302a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:23.406718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:23.407343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:23.407589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:23.429706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:23.431043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:23.504184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1020/2048] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:23.515941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:23.517929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:23.589049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5248445-d5da-477e-bc97-e78e64be74ae admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:23.593471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:23.594169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:23.594491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:23.594763 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:23.605949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:23.607397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f343db0-8b64-43fb-9e1f-05e20fcf5332 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:23.618426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1029/2049] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:24.011894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:24.013975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:24.035407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75536eed-320c-45c1-8894-565e6add2ac9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:24.045461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:24.047008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:24.047501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:24.048231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] PATH_INFO: `/v3/projects/ed30779fc9394bd4a5218d9c62abf7ac` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:24.050657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed30779fc9394bd4a5218d9c62abf7ac)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:24.055491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:24.234368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed30779fc9394bd4a5218d9c62abf7ac', 'request_id': 'req-733e7f63-a2a7-4002-9512-0298554d5e84'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:24.254949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed30779fc9394bd4a5218d9c62abf7ac', 'request_id': 'req-733e7f63-a2a7-4002-9512-0298554d5e84'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:24.277176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed30779fc9394bd4a5218d9c62abf7ac', 'request_id': 'req-733e7f63-a2a7-4002-9512-0298554d5e84'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:24.325920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] The token cache is being invalidate because project ed30779fc9394bd4a5218d9c62abf7ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:24.326629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:24.328358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-733e7f63-a2a7-4002-9512-0298554d5e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:24.331305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1021/2050] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:24 2022] DELETE /identity/v3/projects/ed30779fc9394bd4a5218d9c62abf7ac => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:24.341254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:24.342296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:24.342296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:24.373437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:24.375712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:24.418475 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:24.513004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1030/2051] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:24.518588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:24.519486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:24.519486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:24.571550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:24.573851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:24.591936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1022/2052] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:24.599112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:24.647930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7197ccb2-8ff3-44f8-be7a-5fff0c699767 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:24.669291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:24.675508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:24.675508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:24.676169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:24.678868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:24.681689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:24.694887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:24.724331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1031/2053] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:37:24.731111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:24.765923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360f3a3-1b2e-454d-acd6-92674fa87d8c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:24.784530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:24.786942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:24.787805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:24.788403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:24.790376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:24.793811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:24.814412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:24.859850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1023/2054] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:24 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:24.869338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:24.904496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76374b6b-07a2-4a27-9109-4df1f0238d27 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.036503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.037675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.038644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.039250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.040185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.043036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.088003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1032/2055] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:24 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:25.094656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.142517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4015b-dd52-4662-915a-cf0114201e65 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.155215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.157124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.158422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.159436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.161761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.167508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.218030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1024/2056] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:25.219008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.239948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a492d2-786b-4898-aac4-b38c61ce6f94 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.281353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.287375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.289683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.289683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.290564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.293657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.326194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1033/2057] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:25.331372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.348238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410298a-23e7-473c-8e47-301fb8f2f1b7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.357977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.364989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.365660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.366476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] PATH_INFO: `/v3/projects/21f11cfd3e1440bab4acb55ae12896a5/users/ee3e04d6cf81476f9ab50e3fb765e212/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.412784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=21f11cfd3e1440bab4acb55ae12896a5, user_id=ee3e04d6cf81476f9ab50e3fb765e212, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.419603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8486bc07-4bbd-401c-91bd-6f66053fda3c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.438466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.442679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:25.453975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1025/2058] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:25 2022] PUT /identity/v3/projects/21f11cfd3e1440bab4acb55ae12896a5/users/ee3e04d6cf81476f9ab50e3fb765e212/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:25.456179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.456464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.456741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.501697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] MFA Rules not processed for user `ee3e04d6cf81476f9ab50e3fb765e212`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:25.503781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:25.514653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4897264-f018-4de2-9cde-f3e3befc0034 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.658038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.660355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.660771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.661996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] PATH_INFO: `/v3/users/f7559a8dbe074d4db55e357a6e06205e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.669059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7559a8dbe074d4db55e357a6e06205e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.672396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.715418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1026/2059] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:25.715992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.720699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:25.738796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:25.742249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5f51d-f5e0-4022-88ed-fbd4c7d7a825 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:25.748855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:25.750108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.750621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.751056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] PATH_INFO: `/v3/users/8525df9d186147668dcfab32d44eff8d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.753775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8525df9d186147668dcfab32d44eff8d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:25.754778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:25.773964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7559a8dbe074d4db55e357a6e06205e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.796838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7559a8dbe074d4db55e357a6e06205e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.832191 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7559a8dbe074d4db55e357a6e06205e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.833548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7559a8dbe074d4db55e357a6e06205e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.850415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8525df9d186147668dcfab32d44eff8d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.853500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7559a8dbe074d4db55e357a6e06205e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.863746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1034/2060] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:25 2022] DELETE /identity/v3/users/f7559a8dbe074d4db55e357a6e06205e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:25.864175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8525df9d186147668dcfab32d44eff8d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.867400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8525df9d186147668dcfab32d44eff8d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.870107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:25.873154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:25.883834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8525df9d186147668dcfab32d44eff8d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.885077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-07ab8004-1ae6-4654-849e-e1efd2db4c8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8525df9d186147668dcfab32d44eff8d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:25.912318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1027/2061] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:25 2022] DELETE /identity/v3/users/8525df9d186147668dcfab32d44eff8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:25.914725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3eab-2371-462d-973a-b2e6c83ab15c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:25.914725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3eab-2371-462d-973a-b2e6c83ab15c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:25.914725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb3eab-2371-462d-973a-b2e6c83ab15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:25.943649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2ddb3eab-2371-462d-973a-b2e6c83ab15c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:25.946731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ddb3eab-2371-462d-973a-b2e6c83ab15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:25.968221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:25.993606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6fced8-e3e5-440c-9a2f-8da039ddd74d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.061228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1028/2062] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:26.063337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.063629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.063969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.092559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:26.092559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:26.105931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1029/2063] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:26.107136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.107860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.108752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:26.108946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.109313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.109871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.111111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.114671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.151325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1035/2064] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:25 2022] POST /identity/v3/projects => generated 375 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:26.152517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.155085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:26.195462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf0c8a8-8477-4010-865e-3075a4f4f6a5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.221928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:26.249583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eeb12-c251-4963-ab0a-01a2abc61cf1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.256276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.259030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.259030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.259030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.310224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.311250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.312534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.313312 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.401530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.403092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.415334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1036/2065] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:26.416359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.418094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:26.434876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe7275-4851-45ed-bd38-4f5149221505 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.456896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.458554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.459152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.459605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.461252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.464265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.476778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.479153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.506680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1037/2066] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:26 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:26.510233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1030/2067] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:26.519777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.552592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bfd01-38c6-4aa3-909d-39ae86676917 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.577703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.578806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.579374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.580350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.581751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.584197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.624017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1031/2068] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:26.624806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.641413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7230106-1c5b-4f0a-8cd0-dfcee01da695 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.652167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.653725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.654043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.654644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] PATH_INFO: `/v3/projects/52ba09a6d7664b749a2033008e37bfca/users/1505aa1a43cb4a5ca6376f3ac0443973/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.710964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ba09a6d7664b749a2033008e37bfca, user_id=1505aa1a43cb4a5ca6376f3ac0443973, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.719608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.746127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1038/2069] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:26 2022] PUT /identity/v3/projects/52ba09a6d7664b749a2033008e37bfca/users/1505aa1a43cb4a5ca6376f3ac0443973/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:26.749571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.760463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:26.772198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389bff6-300e-4714-9e1a-36c847d6c0c2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:26.908273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:26.909113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:26.909392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:26.909723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:26.910531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:26.912308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd20a4-f8af-4b77-abc9-f55ce1d18acc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:26.953468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1032/2070] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:26.961329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:26.993458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89f0a1-efee-4de5-98f9-e2c02e70ae20 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:27.000094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:27.001321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.001612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.001888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] PATH_INFO: `/v3/projects/52ba09a6d7664b749a2033008e37bfca/users/1505aa1a43cb4a5ca6376f3ac0443973/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.004636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ba09a6d7664b749a2033008e37bfca, user_id=1505aa1a43cb4a5ca6376f3ac0443973, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:27.008227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:27.027048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1039/2071] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:26 2022] PUT /identity/v3/projects/52ba09a6d7664b749a2033008e37bfca/users/1505aa1a43cb4a5ca6376f3ac0443973/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:27.040843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.041527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.043238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.054473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:27.058853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.098084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] MFA Rules not processed for user `1505aa1a43cb4a5ca6376f3ac0443973`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:27.101377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.238664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aef37-6bdd-4d05-b25d-2e10a24a57a1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:27.244975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:27.245927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.246302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.246759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] PATH_INFO: `/v3/projects/035f4b9cabce4e448497989b1d5273f2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.248943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=035f4b9cabce4e448497989b1d5273f2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:27.251268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:27.287732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1033/2072] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:27.288859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:27.290817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.314953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e56a694-56ec-4bb3-bfa3-e3cc6a0cd08b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:27.320863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:27.322252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.322618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.323049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] PATH_INFO: `/v3/projects/88cf21437d914065b249accaa7963df0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.324677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88cf21437d914065b249accaa7963df0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:27.326892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:27.341255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:27.355075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035f4b9cabce4e448497989b1d5273f2', 'request_id': 'req-c441bc12-fa25-4c85-a21d-39160ebbffa7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.368667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035f4b9cabce4e448497989b1d5273f2', 'request_id': 'req-c441bc12-fa25-4c85-a21d-39160ebbffa7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.376455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035f4b9cabce4e448497989b1d5273f2', 'request_id': 'req-c441bc12-fa25-4c85-a21d-39160ebbffa7'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.397641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] The token cache is being invalidate because project 035f4b9cabce4e448497989b1d5273f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:27.398179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.399347 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.402288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1040/2073] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:27 2022] DELETE /identity/v3/projects/035f4b9cabce4e448497989b1d5273f2 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:27.403776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:27.406580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.417465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88cf21437d914065b249accaa7963df0', 'request_id': 'req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.428176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88cf21437d914065b249accaa7963df0', 'request_id': 'req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.438012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88cf21437d914065b249accaa7963df0', 'request_id': 'req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.457120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] The token cache is being invalidate because project 88cf21437d914065b249accaa7963df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:27.457414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.458379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.463464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1034/2074] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:27 2022] DELETE /identity/v3/projects/88cf21437d914065b249accaa7963df0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:27.463464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:27.463464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.475768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:27.525398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c441bc12-fa25-4c85-a21d-39160ebbffa7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:27.552645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0ba54-d4e8-4275-9a79-b6446d60e3f1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:27.558981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:27.559904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.560189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.560463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] PATH_INFO: `/v3/users/4fa60fa0079a4a7a8bcfc2499086f80d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.561822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa60fa0079a4a7a8bcfc2499086f80d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:27.563941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:27.603026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:27.603748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.604047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.604339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.606893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.626577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa60fa0079a4a7a8bcfc2499086f80d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.636941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa60fa0079a4a7a8bcfc2499086f80d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.637857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa60fa0079a4a7a8bcfc2499086f80d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.650286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa60fa0079a4a7a8bcfc2499086f80d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.651196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-3b20acda-4454-4c0b-88a8-8e70ad638fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa60fa0079a4a7a8bcfc2499086f80d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:27.695592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1035/2075] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:27 2022] DELETE /identity/v3/users/4fa60fa0079a4a7a8bcfc2499086f80d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:27.695592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.695592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.695592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.712776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:27.716706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7042ff8-229c-44c2-b1e1-8feabcd8f67c service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:27.741074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1041/2076] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:27.781834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:27.784181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.915279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1036/2077] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:27.924751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:27.927567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:27.929608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:27.961470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:27.963748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:27.983992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1042/2078] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:27.988283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.004318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cdfa2-c62e-4494-9827-a53ffa98e75d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.019970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.021589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.021789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.022265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.023824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:28.024361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.027622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.052336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1037/2079] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:37:28.057653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.073592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f21bd3-831b-46ac-9bc5-e82dda40bf47 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.080466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.081346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.081699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.081976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.082847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.084977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.136718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1043/2080] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:28 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:28.141755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.161780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f21a844-9951-4038-8036-227e62587a4c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.195533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.198434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:28.208337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:28.253052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:28.361141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.362768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.363386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.363655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.364327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.367692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.401430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1038/2081] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:28 2022] POST /identity/v3/users => generated 291 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:28.407704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.419646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881aadaa-319e-4c63-a3ca-6a360e6f9c4c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.424796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.425664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.425954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.426279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.427051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.429089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.437077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1994dc96-432d-47d4-b645-abc132deded1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.441954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1039/2082] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:28.445121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.446366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.446708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.446990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] PATH_INFO: `/v3/projects/d7a332433f7d4b239c54db4eaeeae1fe` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.448244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.448453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a332433f7d4b239c54db4eaeeae1fe)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.450449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.468168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f11482-cd8c-40e8-a98f-4d0fbd643f7f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.477086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.478169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.478703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.479218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.480769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.483957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.508242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1040/2083] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:28.515205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.522761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a332433f7d4b239c54db4eaeeae1fe', 'request_id': 'req-e78a0166-3167-41f6-ad16-9be015d1e6df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:28.534847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c22416f-84d6-48a8-8e59-e7f43e9c8507 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.537367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a332433f7d4b239c54db4eaeeae1fe', 'request_id': 'req-e78a0166-3167-41f6-ad16-9be015d1e6df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:28.550774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a332433f7d4b239c54db4eaeeae1fe', 'request_id': 'req-e78a0166-3167-41f6-ad16-9be015d1e6df'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:28.595759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] The token cache is being invalidate because project d7a332433f7d4b239c54db4eaeeae1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:28.596453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:28.597799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:28.603288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1044/2084] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:28 2022] DELETE /identity/v3/projects/d7a332433f7d4b239c54db4eaeeae1fe => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:28.608886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.612185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:28.653106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.654245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.654531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.654807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] PATH_INFO: `/v3/projects/849b037f3f424220b53da5537c2cebf3/users/3eb8cf247b6b4d6981191b804790f5f0/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.684763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=849b037f3f424220b53da5537c2cebf3, user_id=3eb8cf247b6b4d6981191b804790f5f0, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.688516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b78421-a1de-4a54-a03b-65c3e3fd5717 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.717817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1041/2085] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:28 2022] PUT /identity/v3/projects/849b037f3f424220b53da5537c2cebf3/users/3eb8cf247b6b4d6981191b804790f5f0/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:28.729254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.729785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.730400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.746243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78a0166-3167-41f6-ad16-9be015d1e6df admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:28.793329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:28.798456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:28.841700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:28.894193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:28.899904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:28.900329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:28.900775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] PATH_INFO: `/v3/users/f1a0eb50ae1c4cf6b15825af03e06b74` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:28.903741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a0eb50ae1c4cf6b15825af03e06b74)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:28.908887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:28.974352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1042/2086] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:28.992356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:28.995698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:29.049433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:29.145332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a0eb50ae1c4cf6b15825af03e06b74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.154198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a0eb50ae1c4cf6b15825af03e06b74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.180966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a0eb50ae1c4cf6b15825af03e06b74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.181704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a0eb50ae1c4cf6b15825af03e06b74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.196586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc92ed1-4fc1-476c-b321-469483a96bd5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:29.198254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a0eb50ae1c4cf6b15825af03e06b74'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.203871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:29.206021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:29.206021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:29.206706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:29.209464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:29.216747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1045/2087] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:28 2022] DELETE /identity/v3/users/f1a0eb50ae1c4cf6b15825af03e06b74 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:29.218490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:29.223019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:29.241179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:29.244888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430a3a97-2692-4751-91be-b5d7d6bb45d2 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:29.274202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1043/2088] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:29.383477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95ee4f-670d-4471-a7c3-6f187687eeb2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:29.390981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:29.392182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:29.392619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:29.393066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] PATH_INFO: `/v3/users/11043d9bd6084e2b8ecd8866351f78c6` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:29.394790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11043d9bd6084e2b8ecd8866351f78c6)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:29.397154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:29.503490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11043d9bd6084e2b8ecd8866351f78c6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.518547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11043d9bd6084e2b8ecd8866351f78c6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.535660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:29.552549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11043d9bd6084e2b8ecd8866351f78c6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.554023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11043d9bd6084e2b8ecd8866351f78c6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.564957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11043d9bd6084e2b8ecd8866351f78c6'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:29.574447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1046/2089] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:29 2022] DELETE /identity/v3/users/11043d9bd6084e2b8ecd8866351f78c6 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:29.580601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:29.582104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:29.582625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:29.627462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:29.629636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:29.788383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1044/2090] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:29.829345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:29.832934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:29.938389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c97148-1038-4c0d-a9e9-3643bd957310 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:29.946091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:29.946948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:29.947315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:29.947944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:29.970445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:29.972450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19c6c6-bfc4-4f59-b8a1-26496b1ee138 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:29.989319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1047/2091] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:30.009871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:30.012292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:30.027033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613e98e-3adc-476d-be86-b6d9c83c3640 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:30.033035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:30.033950 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.034261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.034678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] PATH_INFO: `/v3/projects/930268fd9c6f411ba7d67a93c288bb59` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.036050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=930268fd9c6f411ba7d67a93c288bb59)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:30.038295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:30.138506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '930268fd9c6f411ba7d67a93c288bb59', 'request_id': 'req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:30.151382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '930268fd9c6f411ba7d67a93c288bb59', 'request_id': 'req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:30.167201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '930268fd9c6f411ba7d67a93c288bb59', 'request_id': 'req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:30.207198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] The token cache is being invalidate because project 930268fd9c6f411ba7d67a93c288bb59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:30.210605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:30.214027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-39b577c4-df0f-44a0-b961-2c0b1b3b7da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:30.222281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1045/2092] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:30 2022] DELETE /identity/v3/projects/930268fd9c6f411ba7d67a93c288bb59 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:30.225277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.225818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.226344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.302337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:30.305934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:30.493812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1048/2093] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:30.506007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.507004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.507664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.533284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:30.535242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:30.551479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1046/2094] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:30.553852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:30.568540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba60329-7627-46c1-9baf-fd455472221f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:30.575068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:30.576291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.576859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.577534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.578661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:30.579234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:30.582043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:30.599973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1049/2095] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:30.605962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:30.619015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dced425-8814-47e9-a8bd-7a9be5d39bc2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:30.631082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:30.632413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.633651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.634612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.637889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:30.643085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d63f2-98bf-4021-b7d5-5078306fe2bd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:30.719985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1047/2096] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:30 2022] POST /identity/v3/projects => generated 365 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:30.722678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:30.736116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20a3022-1454-4ba0-88b4-290ed7964df8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:30.881983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.882496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.882792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.893953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:30.909676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:30.911023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:30.912291 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:30.912985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:30.915169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:30.920387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:30.941835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] MFA Rules not processed for user `3eb8cf247b6b4d6981191b804790f5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:30.943892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:30.963140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1050/2097] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:30 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:30.964056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:30.966304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:30.975556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:30.997069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139d40f-952b-49d2-bcd3-bfb518767ae4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.011853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.014350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.015192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.015383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] PATH_INFO: `/v3/projects/1d839777f6d64e0bb2963484e6f87f89` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.020186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d839777f6d64e0bb2963484e6f87f89)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.024810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.052346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1048/2098] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:31.052346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.052346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.065115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc56751-a8d4-42df-bcb1-dbebfc828272 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.072459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.074247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.074995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.075448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] PATH_INFO: `/v3/users/ee3e04d6cf81476f9ab50e3fb765e212` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.077314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3e04d6cf81476f9ab50e3fb765e212)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.079837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.148236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d839777f6d64e0bb2963484e6f87f89', 'request_id': 'req-ff5e0e07-b7e1-4563-b511-f51599bef721'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.151764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3e04d6cf81476f9ab50e3fb765e212'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.163295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d839777f6d64e0bb2963484e6f87f89', 'request_id': 'req-ff5e0e07-b7e1-4563-b511-f51599bef721'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.167008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3e04d6cf81476f9ab50e3fb765e212'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.168712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3e04d6cf81476f9ab50e3fb765e212'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.177746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d839777f6d64e0bb2963484e6f87f89', 'request_id': 'req-ff5e0e07-b7e1-4563-b511-f51599bef721'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.182716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3e04d6cf81476f9ab50e3fb765e212'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.183838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3e04d6cf81476f9ab50e3fb765e212'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.199117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] The token cache is being invalidate because project 1d839777f6d64e0bb2963484e6f87f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:31.199553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.200653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:31.203373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1051/2099] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:30 2022] DELETE /identity/v3/projects/1d839777f6d64e0bb2963484e6f87f89 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:31.205140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.207304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.218081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1049/2100] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:31 2022] DELETE /identity/v3/users/ee3e04d6cf81476f9ab50e3fb765e212 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:31.219596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.222430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.311832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd5b04-4117-48d3-adc6-19677a58aab3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.316696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.317518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.317915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.318379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.321194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.326701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e0e07-b7e1-4563-b511-f51599bef721 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.349848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:31.409031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.410927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacd4721-d931-4e29-bdf8-c6be92196778 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.420514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.421219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.421508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.421789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.422588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.423807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1050/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:31.424282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b8899b-0ece-48ca-b58a-fd31955da5bc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.425703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.426186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.426725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.442903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1052/2102] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:31.442903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c6e4-6b54-4f01-aebc-e9af4efe5ae8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.445152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c6e4-6b54-4f01-aebc-e9af4efe5ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.445797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea2c6e4-6b54-4f01-aebc-e9af4efe5ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.459823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:31.462239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.474185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0ea2c6e4-6b54-4f01-aebc-e9af4efe5ae8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:31.476232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0ea2c6e4-6b54-4f01-aebc-e9af4efe5ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.489763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1051/2103] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:31.489763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.498216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1053/2104] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:31.499630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.499912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.500197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.514707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12bb3f-d544-4444-9dfd-a338597942fe None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.519987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.520604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.520889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.521170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.522118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.523867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.541965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:31.544190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.545099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1052/2105] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:31.546543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.549663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.559910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1054/2106] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:31.566461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.585365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f3e07-b9a1-40d9-a979-8dd0b1eaa98c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.594108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.596539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.597306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.597970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] PATH_INFO: `/v3/projects/7527f02709d84609a115db6775c1a1a2/users/26cc1fd4ee48428685241ca6879fd4c6/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.623034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:31.633109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7527f02709d84609a115db6775c1a1a2, user_id=26cc1fd4ee48428685241ca6879fd4c6, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.637365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.659669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243072c3-da87-4731-9577-c0d78b6508a4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.664034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1055/2107] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:31 2022] PUT /identity/v3/projects/7527f02709d84609a115db6775c1a1a2/users/26cc1fd4ee48428685241ca6879fd4c6/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:31.666755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.746773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.747506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.747799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.748103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.802343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1611d5-93ad-433e-945a-2d4888cb32b8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.809939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.810999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.811510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.811953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.813506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:31.813940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.816542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff0a1e-e94d-4787-a7aa-2df69ac272f7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.844847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1056/2108] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:31.849261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.849764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.850507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.874640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.876325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.890133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1053/2109] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:31.890943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:31.909114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3348f2-31f0-4bda-967f-f7ca88ddb83c service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:31.921735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:31.922616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:31.922946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:31.923443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:31.924963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:31.929857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:31.935067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] MFA Rules not processed for user `26cc1fd4ee48428685241ca6879fd4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:31.937908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:31.946334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:32.014264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1054/2110] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:31 2022] POST /identity/v3/projects => generated 369 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:32.020873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.226654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1057/2111] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:32.230754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.259579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fe88ca-c73e-4294-aee6-333a8580b63c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.268233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.269448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.269957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.270499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.271719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.276879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.279147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3e92-793a-4737-89fa-f4f88dfc6889 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.293154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.295740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.296532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.297647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.298777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.313952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.354631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1055/2112] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:32 2022] POST /identity/v3/users => generated 285 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:32.359023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1058/2113] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:32 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:32.361249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.364777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.383464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ff300-6fc0-4470-83f3-df21e62bd2fa admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.443965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:32.470693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ab0603-4bb1-4f09-9516-f62baa86b1de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.479400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.480126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.480576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.481035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.481766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.483823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.485470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.486702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.487191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.487687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.489080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.492624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.514785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1056/2114] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:32.515963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1059/2115] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:32 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:32.521048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.522221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.534557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8910-a38f-4ca0-a10d-7124834f5b0c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.534930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a829-691e-420c-98f1-c999c208b168 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.542033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.542852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.543133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.543414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.544187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.545945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.547162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.548555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.549072 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.549649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.551237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.555949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.558440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1060/2116] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:32.567792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.574709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1057/2117] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:32.575667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.577379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:32.596306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75181ab-bc30-4c11-bd6a-072ac26e3fa8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.599132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1024c94-f69b-430b-89a7-90bb8596bffe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.605212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.605870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.606100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.606383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.606680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] PATH_INFO: `/v3/projects/21f11cfd3e1440bab4acb55ae12896a5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.606949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.607114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.607377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] PATH_INFO: `/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb/users/4e0ec8ec0299489794e28c33a706aedc/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.608496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21f11cfd3e1440bab4acb55ae12896a5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.610781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.635908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4de69f351fc4f7fbfa07aefc395b3cb, user_id=4e0ec8ec0299489794e28c33a706aedc, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.640883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.665238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1061/2118] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:32 2022] PUT /identity/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb/users/4e0ec8ec0299489794e28c33a706aedc/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:32.669919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.678632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21f11cfd3e1440bab4acb55ae12896a5', 'request_id': 'req-01b23b5f-4972-41c7-a3f0-7fd58b628c70'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:32.687798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:32.689572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21f11cfd3e1440bab4acb55ae12896a5', 'request_id': 'req-01b23b5f-4972-41c7-a3f0-7fd58b628c70'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:32.704213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21f11cfd3e1440bab4acb55ae12896a5', 'request_id': 'req-01b23b5f-4972-41c7-a3f0-7fd58b628c70'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:32.727802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] The token cache is being invalidate because project 21f11cfd3e1440bab4acb55ae12896a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:32.728260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:32.729419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:32.732006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1058/2119] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:32 2022] DELETE /identity/v3/projects/21f11cfd3e1440bab4acb55ae12896a5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:32.733489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.735872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:32.762544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b3cc6c-ecdf-4ba5-bb74-aa550e88bf56 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.770081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.771665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.772134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.772748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] PATH_INFO: `/v3/projects/b902945afee143b19beb3366841fd72d/users/0e92ccbb22394817bd8a4224cc0d4e13/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.802801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b902945afee143b19beb3366841fd72d, user_id=0e92ccbb22394817bd8a4224cc0d4e13, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.808737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.826956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b23b5f-4972-41c7-a3f0-7fd58b628c70 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.831551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1062/2120] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:32 2022] PUT /identity/v3/projects/b902945afee143b19beb3366841fd72d/users/0e92ccbb22394817bd8a4224cc0d4e13/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:32.832996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.836419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:32.923814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.924735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.925157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.925595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.926910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.929796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48665af6-2871-453f-8fce-572f418c1f73 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.944861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1059/2121] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:32.947825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.948201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.948389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.957175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdaa57a-25a1-406c-9178-bc7380bbe9a6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:32.963146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:32.964619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:32.964954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:32.965382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] PATH_INFO: `/v3/users/1505aa1a43cb4a5ca6376f3ac0443973` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:32.967099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1505aa1a43cb4a5ca6376f3ac0443973)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:32.969378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:32.969582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:32.970745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:32.979769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1060/2122] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:32.980897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:32.997132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098de3b-3ace-4ebb-965d-73f28a087ba4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:33.002189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:33.003142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.003426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.003702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] PATH_INFO: `/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb/users/4e0ec8ec0299489794e28c33a706aedc/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.005866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4de69f351fc4f7fbfa07aefc395b3cb, user_id=4e0ec8ec0299489794e28c33a706aedc, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:33.009133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:33.023420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1061/2123] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:32 2022] PUT /identity/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb/users/4e0ec8ec0299489794e28c33a706aedc/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:33.024419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:33.026300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.043192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:33.061674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1505aa1a43cb4a5ca6376f3ac0443973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.072600 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1505aa1a43cb4a5ca6376f3ac0443973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.091678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1505aa1a43cb4a5ca6376f3ac0443973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.092868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1505aa1a43cb4a5ca6376f3ac0443973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.103960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-6fbf6de0-3f35-4acc-b873-519f3e46e7a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1505aa1a43cb4a5ca6376f3ac0443973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.112077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1063/2124] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:32 2022] DELETE /identity/v3/users/1505aa1a43cb4a5ca6376f3ac0443973 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:33.118992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.119837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.119837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.153709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1f17c-50f4-4dfb-acd4-fa0afa8e1973 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:33.172491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] MFA Rules not processed for user `4e0ec8ec0299489794e28c33a706aedc`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:33.175882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.192798 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:33.252808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:33.273703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.276006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.276286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.282677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.414361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1064/2125] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:33.434933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:33.437932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.443631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:33.446445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:33.468770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1062/2126] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:33.543376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462c1b7-40da-4127-89cf-abe964c9741f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:33.549560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:33.550495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.550921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.551693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.564632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:33.565359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:33.579361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1065/2127] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:33.710945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:33.727357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5b04e-7f22-4151-b93c-557441c3b39f service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:33.734453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:33.735426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.735867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.736360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.739490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.759528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:33.761485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:33.791173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae404b5c-279c-4e10-8d8a-3c4d657ba923 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:33.800955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:33.802422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:33.802860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:33.803346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] PATH_INFO: `/v3/projects/52ba09a6d7664b749a2033008e37bfca` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:33.806139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ba09a6d7664b749a2033008e37bfca)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:33.809585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:33.887972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:33.898470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:33.900989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e63de-4778-4759-b445-25938ccfde80 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:33.921015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ba09a6d7664b749a2033008e37bfca', 'request_id': 'req-33bb22ea-78a5-488b-b8db-7e386da1bb5e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.931660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1063/2128] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:33.942022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ba09a6d7664b749a2033008e37bfca', 'request_id': 'req-33bb22ea-78a5-488b-b8db-7e386da1bb5e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.962302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ba09a6d7664b749a2033008e37bfca', 'request_id': 'req-33bb22ea-78a5-488b-b8db-7e386da1bb5e'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.992934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] The token cache is being invalidate because project 52ba09a6d7664b749a2033008e37bfca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:33.993758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.994774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bb22ea-78a5-488b-b8db-7e386da1bb5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:33.996989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1066/2129] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:33 2022] DELETE /identity/v3/projects/52ba09a6d7664b749a2033008e37bfca => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:34.003064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.003529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.003980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.030628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:34.032434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:34.154341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1064/2130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:34.159170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.159451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.159731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.207440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:34.208719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:34.231356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1067/2131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:34.233126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.271953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dca3e-b382-4a3c-bbb9-c60e6418d5c7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.285645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.290275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.291174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.292163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.294512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:34.295479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.299439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.331704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1065/2132] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:34.337808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:34.342560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.368677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb752c6-5f17-45dd-b760-6e18ecaedc2f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.377373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.378523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.379480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.379602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.381043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.384980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.426119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1068/2133] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:34.429112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.456404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c420a7-13db-4032-b40a-e42007024c31 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.580976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.581818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.582304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.582790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.584416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.592767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.640567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1066/2134] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:34.640956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.657160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89916d2-4957-4299-a5de-ee41045e57b6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.667779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.669335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.670125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.678781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.680031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.682359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.706778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1069/2135] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:34.707609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.721937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c8353-bc65-4764-ba23-6cfd9164f367 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.731503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.732734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.733203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.733499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.734750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.737061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c879b-0764-44ac-b7dd-8140e3034470 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.753204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1067/2136] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:34.760161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:34.790185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513af652-7c79-4334-9d52-6fbe32dda903 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:34.808374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:34.808374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.808374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.808374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] PATH_INFO: `/v3/projects/99c27245c0e64359b9790a3143fbc466/users/5f56b01c51ac47be95233d368bb7f285/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.811373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.811811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.812229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.853352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c27245c0e64359b9790a3143fbc466, user_id=5f56b01c51ac47be95233d368bb7f285, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:34.859160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa34f09-8fc7-467f-9074-ce07980df95c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:34.880188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] MFA Rules not processed for user `0e92ccbb22394817bd8a4224cc0d4e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:34.881419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:34.893175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1070/2137] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:34 2022] PUT /identity/v3/projects/99c27245c0e64359b9790a3143fbc466/users/5f56b01c51ac47be95233d368bb7f285/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:34.905000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:34.905287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:34.905562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:34.952151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] MFA Rules not processed for user `5f56b01c51ac47be95233d368bb7f285`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:34.955673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:35.039186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1068/2138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:35.054107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1071/2139] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:35.054996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:35.057352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:35.063390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:35.065250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:35.146397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:35.148427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaae45-a8a0-4474-8c45-9980ab130b05 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:35.152942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:35.153601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:35.153884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:35.154251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:35.156684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abfcce2-f52f-421e-ad4f-e7705c614e35 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:35.164510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:35.164775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:35.165807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:35.166322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:35.166503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e5534-1516-4056-8cf3-a8d2bd7124a5 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:35.166796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:35.177099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1069/2140] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:35.184483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:35.187188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c58f05-2854-4c19-875b-aa8b5c7639e9 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:35.205681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1072/2141] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:36.684953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:36.685706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:36.686286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:36.710914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] MFA Rules not processed for user `3eb8cf247b6b4d6981191b804790f5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:36.712561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:36.722496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:36.865592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1070/2142] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:38.963231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0418-8195-40df-a823-6d61689e8add None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:38.965173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0418-8195-40df-a823-6d61689e8add None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:38.965876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7e0418-8195-40df-a823-6d61689e8add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:38.999319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-eb7e0418-8195-40df-a823-6d61689e8add None None] MFA Rules not processed for user `0e92ccbb22394817bd8a4224cc0d4e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:39.002346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eb7e0418-8195-40df-a823-6d61689e8add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:39.014123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1073/2143] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:41.067840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:41.071751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:41.220581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86af24ac-5909-41da-96c9-79ea7af79843 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:41.247370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:41.249824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:41.250396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:41.251126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] PATH_INFO: `/v3/users/62eb389f889f4d6ab7264e54f643c4ef` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:41.254245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=62eb389f889f4d6ab7264e54f643c4ef)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:41.262593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:41.409498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62eb389f889f4d6ab7264e54f643c4ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.436990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62eb389f889f4d6ab7264e54f643c4ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.442908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62eb389f889f4d6ab7264e54f643c4ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.460278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62eb389f889f4d6ab7264e54f643c4ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.464445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62eb389f889f4d6ab7264e54f643c4ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.554853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1071/2144] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:41 2022] DELETE /identity/v3/users/62eb389f889f4d6ab7264e54f643c4ef => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:41.559941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:41.560599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:41.561032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:41.591713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:41.593711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:41.687960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1074/2145] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:41.706331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:41.721063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:41.726217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:41.728460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:41.763507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff81b0f-e763-422e-96f7-adb43367f628 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:41.807585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:41.808825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:41.809278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:41.809725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] PATH_INFO: `/v3/users/5f56b01c51ac47be95233d368bb7f285` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:41.814224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f56b01c51ac47be95233d368bb7f285)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:41.816180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:41.836517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:41.896541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7373b95-c536-4466-9317-e56ef3ac6a0e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:41.921649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:41.923109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:41.923722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:41.924204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:41.943361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:41.946664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f56b01c51ac47be95233d368bb7f285'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.947070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f67857-7a69-4beb-8c6e-666467aa3051 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:41.965946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f56b01c51ac47be95233d368bb7f285'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:41.969680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1072/2146] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:42.004974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f56b01c51ac47be95233d368bb7f285'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.007024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f56b01c51ac47be95233d368bb7f285'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.022779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f56b01c51ac47be95233d368bb7f285'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.031793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1075/2147] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:41 2022] DELETE /identity/v3/users/5f56b01c51ac47be95233d368bb7f285 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:42.041776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:42.042231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:42.042728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:42.075511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:42.077720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:42.209648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1073/2148] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:42.243667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:42.248168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:42.439357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d865c-51f3-4d10-ba0f-47375c067cf7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:42.448351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:42.448657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:42.449723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:42.449723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:42.470682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:42.475455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:42.484045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:42.503252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1076/2149] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:42.658398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:42.661704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:42.692068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291f9ef0-fbe5-4a9b-b1b6-64197c4947d6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:42.711652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:42.714433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:42.715253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:42.717721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] PATH_INFO: `/v3/users/26cc1fd4ee48428685241ca6879fd4c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:42.723906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cc1fd4ee48428685241ca6879fd4c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:42.733027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:42.770655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:42.773278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:42.847802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d68452-8502-4db1-9e30-f2a538e19b2e service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:42.889499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:42.891229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:42.898441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:42.899091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] PATH_INFO: `/v3/projects/2083ebbb231843efaef49da9aa67ab55` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:42.901851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2083ebbb231843efaef49da9aa67ab55)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:42.913285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:42.950281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cc1fd4ee48428685241ca6879fd4c6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.971858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cc1fd4ee48428685241ca6879fd4c6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.972896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cc1fd4ee48428685241ca6879fd4c6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:42.998979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cc1fd4ee48428685241ca6879fd4c6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.000721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-e1eb2885-0c2e-436c-83a1-8eafd11e86d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cc1fd4ee48428685241ca6879fd4c6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.054923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1074/2150] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:42 2022] DELETE /identity/v3/users/26cc1fd4ee48428685241ca6879fd4c6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:43.061613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2083ebbb231843efaef49da9aa67ab55', 'request_id': 'req-b2813a2e-165d-4888-9fb9-fe41df621413'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.062739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:43.063913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:43.064707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:43.082764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2083ebbb231843efaef49da9aa67ab55', 'request_id': 'req-b2813a2e-165d-4888-9fb9-fe41df621413'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.107412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2083ebbb231843efaef49da9aa67ab55', 'request_id': 'req-b2813a2e-165d-4888-9fb9-fe41df621413'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.108700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:43.114364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:43.146560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] The token cache is being invalidate because project 2083ebbb231843efaef49da9aa67ab55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:43.148761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.151624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.157020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1077/2151] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:42 2022] DELETE /identity/v3/projects/2083ebbb231843efaef49da9aa67ab55 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:43.164526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:43.168578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:43.237561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:43.311259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1075/2152] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:43.359531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:43.372885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:43.414172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2813a2e-165d-4888-9fb9-fe41df621413 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:43.425495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:43.428630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:43.430512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:43.430806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] PATH_INFO: `/v3/users/5943549ddd5e458eab6caaaf0ff707c8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:43.436409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5943549ddd5e458eab6caaaf0ff707c8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:43.440341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:43.535045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742663d-a0fd-4e98-baae-99d1e9f16004 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:43.545127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:43.546391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:43.546874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:43.547151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5943549ddd5e458eab6caaaf0ff707c8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.547949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:43.569864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5943549ddd5e458eab6caaaf0ff707c8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.574098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:43.577308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:43.597985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5943549ddd5e458eab6caaaf0ff707c8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.598918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5943549ddd5e458eab6caaaf0ff707c8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.612294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5943549ddd5e458eab6caaaf0ff707c8'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:43.617058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:43.618463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1076/2153] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:43.623194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1078/2154] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:43 2022] DELETE /identity/v3/users/5943549ddd5e458eab6caaaf0ff707c8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:43.933340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:43.938680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:43.957258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6c73f-b02c-4872-9ff0-35e8d1c3cd1f service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:44.136995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:44.139892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:44.140380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:44.140880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] PATH_INFO: `/v3/projects/99c27245c0e64359b9790a3143fbc466` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:44.143516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c27245c0e64359b9790a3143fbc466)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:44.148719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:44.245023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c27245c0e64359b9790a3143fbc466', 'request_id': 'req-280a021e-6aa3-404d-acfe-4280a32e32a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.260052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c27245c0e64359b9790a3143fbc466', 'request_id': 'req-280a021e-6aa3-404d-acfe-4280a32e32a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.271378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c27245c0e64359b9790a3143fbc466', 'request_id': 'req-280a021e-6aa3-404d-acfe-4280a32e32a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.296238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] The token cache is being invalidate because project 99c27245c0e64359b9790a3143fbc466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:44.297134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.300563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-280a021e-6aa3-404d-acfe-4280a32e32a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.314684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1077/2155] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:43 2022] DELETE /identity/v3/projects/99c27245c0e64359b9790a3143fbc466 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:44.456000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:44.457626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:44.483516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0e085-9140-4057-9628-02b920557c91 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:44.593092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:44.594031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:44.594430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:44.594704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] PATH_INFO: `/v3/projects/697af989f3d3484e9aeff2edea6cb70b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:44.596727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=697af989f3d3484e9aeff2edea6cb70b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:44.599965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:44.708021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697af989f3d3484e9aeff2edea6cb70b', 'request_id': 'req-a187833f-9524-4b30-9b90-8ce660f17500'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.727650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697af989f3d3484e9aeff2edea6cb70b', 'request_id': 'req-a187833f-9524-4b30-9b90-8ce660f17500'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.738918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697af989f3d3484e9aeff2edea6cb70b', 'request_id': 'req-a187833f-9524-4b30-9b90-8ce660f17500'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.764123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] The token cache is being invalidate because project 697af989f3d3484e9aeff2edea6cb70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:44.764766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.766278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:44.772057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1079/2156] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:44 2022] DELETE /identity/v3/projects/697af989f3d3484e9aeff2edea6cb70b => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:44.778674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276070-2178-4010-a274-b419f47da649 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:44.778674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276070-2178-4010-a274-b419f47da649 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:44.780708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51276070-2178-4010-a274-b419f47da649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:44.828746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-51276070-2178-4010-a274-b419f47da649 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:44.831108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-51276070-2178-4010-a274-b419f47da649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:44.847446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:44.851120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:44.863210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:44.967500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1078/2157] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:44.977883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:44.978308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:44.978602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.011744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:45.014653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:45.027893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1079/2158] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:45.033307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.045507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dbfcc-7f02-438d-819a-5adf587d6aad None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.055770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.056628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.057088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.057389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.058391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:45.058803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.061081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.082397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187833f-9524-4b30-9b90-8ce660f17500 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.091419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.092464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.097099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.097099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] PATH_INFO: `/v3/projects/7527f02709d84609a115db6775c1a1a2` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.098253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1080/2159] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:45.101014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7527f02709d84609a115db6775c1a1a2)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.103916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.107056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.123183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a84f1-45ae-44f3-ac82-be1b5e3cf0c2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.135501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.137583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.138497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.138497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.140060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.142927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.170827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:45.180352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1081/2160] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:45 2022] POST /identity/v3/projects => generated 361 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:45.190998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.210721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7527f02709d84609a115db6775c1a1a2', 'request_id': 'req-30c2e128-88a2-4e06-a54d-6977e5bc8062'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.228099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7527f02709d84609a115db6775c1a1a2', 'request_id': 'req-30c2e128-88a2-4e06-a54d-6977e5bc8062'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.236424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7527f02709d84609a115db6775c1a1a2', 'request_id': 'req-30c2e128-88a2-4e06-a54d-6977e5bc8062'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.254896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] The token cache is being invalidate because project 7527f02709d84609a115db6775c1a1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:45.255265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.255990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.263467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1080/2161] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:44 2022] DELETE /identity/v3/projects/7527f02709d84609a115db6775c1a1a2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:45.263826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.265916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:45.327490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f58aaa3-73bd-46c3-bad2-e605f7afd64d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.340797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.341482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.341770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.342087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.342854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.346640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.391189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2e128-88a2-4e06-a54d-6977e5bc8062 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.402249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1082/2162] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:45 2022] POST /identity/v3/users => generated 281 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:45.431988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.436046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.437004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.437287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.437569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] PATH_INFO: `/v3/users/4e0ec8ec0299489794e28c33a706aedc` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.439253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e0ec8ec0299489794e28c33a706aedc)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.441948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:45.444530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.471884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c8d72-7e02-4922-8f4b-c7fc87823e9f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.488924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.489931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.490267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.490553 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.491468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.493363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.533001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1083/2163] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:45.544437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.574153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a969a0-d1d6-4e7a-a373-a0e1df582ee7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.579990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e0ec8ec0299489794e28c33a706aedc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.582345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.583769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.584107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.585003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.585524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.587477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.608896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1084/2164] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:45.612191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.612757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e0ec8ec0299489794e28c33a706aedc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.629793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143a7a1-bdea-4da7-b353-db00219ef589 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:45.637099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:45.638819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.639500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.639843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] PATH_INFO: `/v3/projects/ecf30c1f7eda47c59a69c6644fac53b5/users/6e1b32423d8041bba26605ae31c68a05/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.647626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e0ec8ec0299489794e28c33a706aedc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.648866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e0ec8ec0299489794e28c33a706aedc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.664318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-27168965-53bc-438b-97e4-24a1be9fd1c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e0ec8ec0299489794e28c33a706aedc'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:45.669408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf30c1f7eda47c59a69c6644fac53b5, user_id=6e1b32423d8041bba26605ae31c68a05, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:45.674505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:45.678608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1081/2165] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:45 2022] DELETE /identity/v3/users/4e0ec8ec0299489794e28c33a706aedc => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:45.710171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1085/2166] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:45 2022] PUT /identity/v3/projects/ecf30c1f7eda47c59a69c6644fac53b5/users/6e1b32423d8041bba26605ae31c68a05/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:45.724164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:45.724533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:45.724857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:45.763413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] MFA Rules not processed for user `6e1b32423d8041bba26605ae31c68a05`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:45.764725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:45.824642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:45.920873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1082/2167] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:45.928802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:45.931823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.027991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:46.100806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5597507-b696-419c-9645-fa74ec3be3cf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.106509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.107894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.108328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.108774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.110115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.112109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.156532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1086/2168] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:45 2022] POST /identity/v3/projects => generated 363 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:46.164790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.190355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0c70c-2668-463d-8f96-1eccfa2d4a92 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.311007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.311719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.312004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.312284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.313002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.315087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.333034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.336333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.349591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1083/2169] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:46.359526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.369029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f4ee9-1902-4fa9-b903-59c18addb326 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.378856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.380367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.380872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.381393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] PATH_INFO: `/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.384234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4de69f351fc4f7fbfa07aefc395b3cb)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.388576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.389500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d892a9d-9667-421e-b413-7c7fa471285a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.398196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.398196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.398493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.398568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.409861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.413365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.435606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1084/2170] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:46.441421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.461035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b31219-5fbc-43fe-95ee-f5400cb6166a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.472572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.474192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.475614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.475614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] PATH_INFO: `/v3/projects/f2874e38419f44319bc4b787e4cf29bb/users/a495a8e944554f82b91fa6eafabfb2f0/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.498889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2874e38419f44319bc4b787e4cf29bb, user_id=a495a8e944554f82b91fa6eafabfb2f0, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.502617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.512790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4de69f351fc4f7fbfa07aefc395b3cb', 'request_id': 'req-7d45cc72-2430-4bb1-917a-e004010e3817'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:46.525081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1085/2171] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:46 2022] PUT /identity/v3/projects/f2874e38419f44319bc4b787e4cf29bb/users/a495a8e944554f82b91fa6eafabfb2f0/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:46.530816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.531568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4de69f351fc4f7fbfa07aefc395b3cb', 'request_id': 'req-7d45cc72-2430-4bb1-917a-e004010e3817'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:46.551052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4de69f351fc4f7fbfa07aefc395b3cb', 'request_id': 'req-7d45cc72-2430-4bb1-917a-e004010e3817'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:46.572952 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] The token cache is being invalidate because project c4de69f351fc4f7fbfa07aefc395b3cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:46.573350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:46.573983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7d45cc72-2430-4bb1-917a-e004010e3817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:46.575898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1087/2172] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:46 2022] DELETE /identity/v3/projects/c4de69f351fc4f7fbfa07aefc395b3cb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:46.584194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa8b36-489c-4533-bd40-59bd501b137c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.584876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa8b36-489c-4533-bd40-59bd501b137c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.585316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa8b36-489c-4533-bd40-59bd501b137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.608449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a3fa8b36-489c-4533-bd40-59bd501b137c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:46.609984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a3fa8b36-489c-4533-bd40-59bd501b137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.635514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656bb355-ae81-42a6-9648-34cbd8cc5ff8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.650927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.651641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.651949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.652210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.652998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.654730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.667409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1086/2173] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:46.672003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.674715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.690008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f3d8-6b13-4527-a24f-7e561e38200f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.696708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.698251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.698747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.699236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] PATH_INFO: `/v3/projects/f2874e38419f44319bc4b787e4cf29bb/users/a495a8e944554f82b91fa6eafabfb2f0/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.702767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2874e38419f44319bc4b787e4cf29bb, user_id=a495a8e944554f82b91fa6eafabfb2f0, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.704972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1088/2174] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:46.708478 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd1cf2-321f-4619-b8ff-46a62bd7f9be admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.714833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.715668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.716130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.737691 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1087/2175] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:46 2022] PUT /identity/v3/projects/f2874e38419f44319bc4b787e4cf29bb/users/a495a8e944554f82b91fa6eafabfb2f0/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:46.738561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:46.740049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.755760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.756259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.756972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.779946 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:46.783478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:46.807783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] MFA Rules not processed for user `a495a8e944554f82b91fa6eafabfb2f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:46.809896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.825201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1089/2176] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:46.830461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.841128 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897450-fce8-496a-a085-182a1e995e1e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.846119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.846832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.847114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.847385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.848172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:46.848480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.850358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.865626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1090/2177] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:37:46.872373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.884601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5620e6-a231-4ecf-8b2d-d72ffdca2e96 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:46.890715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:46.891406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:46.892443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:46.892730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:46.893466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:46.895521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:46.922286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1088/2178] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:46.933506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1091/2179] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:46.936172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.940538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:46.943108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:46.954512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf5dec-0af2-4349-b245-784a61080d39 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:47.044938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd8795-adaa-4f3c-b51b-fc00923cfdf7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:47.050368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:47.051212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.051614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.052080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.072130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:47.073374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.073812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.074491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.075484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:47.078753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:47.109955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1089/2180] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:46 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:47.113555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:47.134994 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e6153-ccef-4f99-baaa-fded24027089 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:47.144017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:47.145898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.145898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.146276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.147916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:47.149620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:47.150984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:47.152744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:47.165508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1092/2181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:47.169818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1090/2182] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:47.176679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:47.196500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a7631-f86a-4ae5-9a64-be683f9dcb92 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:47.206780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:47.208690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.209567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.210252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.211621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:47.214511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb834d8-7a8d-422a-95f5-3c6f5ee5f3c4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:47.242162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1093/2183] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:47.248511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:47.302964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd770c7a-11ae-4d8c-9f62-8acb8d634b8a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:47.310177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:47.312930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.313194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.313501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] PATH_INFO: `/v3/projects/d3f45b6964464b3788e5b36946aa2089/users/0ec8a1dcfac145fa8ec89d3d439ce294/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.413517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f45b6964464b3788e5b36946aa2089, user_id=0ec8a1dcfac145fa8ec89d3d439ce294, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:47.421744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:47.499595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1091/2184] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:47 2022] PUT /identity/v3/projects/d3f45b6964464b3788e5b36946aa2089/users/0ec8a1dcfac145fa8ec89d3d439ce294/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:47.506858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:47.507305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:47.519069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:47.675753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:47.680209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:47.707796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:47.973111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1094/2185] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:47.981851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:47.984303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:48.097237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:48.217464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb360dc-9251-41e4-a7d0-12c9748e391b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:48.222366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:48.222963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:48.223252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:48.223533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:48.244268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:48.245951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:48.247585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60562557-09a0-4685-a7c8-66fa7e0be6df service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:48.268054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a30951b-8fa5-4b45-96af-ed4801808b68 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:48.273769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1092/2186] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:48.287295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:48.290993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:48.293088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:48.294084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] PATH_INFO: `/v3/users/6e1b32423d8041bba26605ae31c68a05` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:48.298881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1b32423d8041bba26605ae31c68a05)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:48.305402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:48.413398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1b32423d8041bba26605ae31c68a05'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:48.425545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1b32423d8041bba26605ae31c68a05'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:48.426869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1b32423d8041bba26605ae31c68a05'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:48.438391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1b32423d8041bba26605ae31c68a05'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:48.439099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1b32423d8041bba26605ae31c68a05'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:48.469714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1095/2187] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:48 2022] DELETE /identity/v3/users/6e1b32423d8041bba26605ae31c68a05 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:48.477779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f301-da5f-4904-adf5-701e018a7b57 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:48.478295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f301-da5f-4904-adf5-701e018a7b57 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:48.478760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578f301-da5f-4904-adf5-701e018a7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:48.514170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b578f301-da5f-4904-adf5-701e018a7b57 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:48.516523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b578f301-da5f-4904-adf5-701e018a7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:48.662340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1093/2188] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:37:48.679388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:48.683192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:48.869361 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f323fe-eed5-46ab-9837-9508954be3e3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:48.884428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:48.887237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:48.887814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:48.888317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:48.931266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:48.934212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:48.942727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:48.963226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1096/2189] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:49.563614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:49.565247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:49.566439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:49.688268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] MFA Rules not processed for user `0ec8a1dcfac145fa8ec89d3d439ce294`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:49.688782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:49.737835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:49.741349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:49.768554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cc2f2b-5fde-4ccc-8707-d98009427fb5 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:49.777624 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:49.779376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:49.780154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:49.780912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] PATH_INFO: `/v3/projects/ecf30c1f7eda47c59a69c6644fac53b5` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:49.784245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf30c1f7eda47c59a69c6644fac53b5)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:49.789090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:49.817843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1094/2190] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:49.822394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:49.824197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:49.847577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c471e50-0cac-4237-a406-42c8bfeb5c2b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:49.867667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:49.869239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:49.872408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:49.872408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:49.872408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:49.876214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:49.911731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf30c1f7eda47c59a69c6644fac53b5', 'request_id': 'req-10ec9589-90bb-4811-94a9-15dda2b6dd81'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:49.927051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf30c1f7eda47c59a69c6644fac53b5', 'request_id': 'req-10ec9589-90bb-4811-94a9-15dda2b6dd81'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:49.932688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1095/2191] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:49 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:49.935307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf30c1f7eda47c59a69c6644fac53b5', 'request_id': 'req-10ec9589-90bb-4811-94a9-15dda2b6dd81'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:49.939199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:49.951299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] The token cache is being invalidate because project ecf30c1f7eda47c59a69c6644fac53b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:49.951631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:49.951816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:49.952487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:49.955219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1097/2192] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:49 2022] DELETE /identity/v3/projects/ecf30c1f7eda47c59a69c6644fac53b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:49.959816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:49.962002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:50.052569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90777-5c82-4986-9128-a01757ff4468 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.060435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.060747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.061078 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.061455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.062382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.064544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.088674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1096/2193] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:49 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:50.090448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec9589-90bb-4811-94a9-15dda2b6dd81 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.092966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:50.094977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:50.108432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.110041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.110574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.111345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] PATH_INFO: `/v3/users/a495a8e944554f82b91fa6eafabfb2f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.112022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4bf709-f51a-4368-a1ad-f2e5ee139fef admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.113723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a495a8e944554f82b91fa6eafabfb2f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.118166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.118625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.119222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.119574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.119922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.120755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.122747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.136465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1097/2194] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:50.141272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:50.155830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cc8f4-3a86-4e00-a9d9-b26ec8bdb303 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.163803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.164920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.165332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.165679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] PATH_INFO: `/v3/projects/d635f5494d5443ee9daca435f41d25b9/users/04ec0ae1329c4e6cac12edeb556af858/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.196153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d635f5494d5443ee9daca435f41d25b9, user_id=04ec0ae1329c4e6cac12edeb556af858, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.202016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.222464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a495a8e944554f82b91fa6eafabfb2f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:50.227330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1098/2195] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:50 2022] PUT /identity/v3/projects/d635f5494d5443ee9daca435f41d25b9/users/04ec0ae1329c4e6cac12edeb556af858/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:50.232034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:50.234668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a495a8e944554f82b91fa6eafabfb2f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:50.235545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a495a8e944554f82b91fa6eafabfb2f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:50.245307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a495a8e944554f82b91fa6eafabfb2f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:50.246022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a495a8e944554f82b91fa6eafabfb2f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:50.270962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:50.278837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1098/2196] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:49 2022] DELETE /identity/v3/users/a495a8e944554f82b91fa6eafabfb2f0 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:50.337678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c2f62-2c56-442c-ae29-8a9a39c65a1b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.430015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.430765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.431050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.431330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.432120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.433861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.449943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1099/2197] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:50.452849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:50.455643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:50.480770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1970b-87b0-4adb-ae92-e272e986253c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.489617 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.491347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.491805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.492267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] PATH_INFO: `/v3/projects/d635f5494d5443ee9daca435f41d25b9/users/04ec0ae1329c4e6cac12edeb556af858/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.496301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d635f5494d5443ee9daca435f41d25b9, user_id=04ec0ae1329c4e6cac12edeb556af858, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.501742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06deb9ee-41a2-4387-af7f-eeb19bbc9d9b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:50.529799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1099/2198] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:50 2022] PUT /identity/v3/projects/d635f5494d5443ee9daca435f41d25b9/users/04ec0ae1329c4e6cac12edeb556af858/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:50.798613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:50.805062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:50.823638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:50.833828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bfd9b-a228-44ad-81c3-1361aa819b79 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:50.948270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:50.949364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:50.949715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:50.950109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] PATH_INFO: `/v3/projects/f2874e38419f44319bc4b787e4cf29bb` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:50.951705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2874e38419f44319bc4b787e4cf29bb)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:50.954035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:51.067363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2874e38419f44319bc4b787e4cf29bb', 'request_id': 'req-d4998770-5c06-49d5-b992-2de767cf2665'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:51.081936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2874e38419f44319bc4b787e4cf29bb', 'request_id': 'req-d4998770-5c06-49d5-b992-2de767cf2665'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:51.095793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2874e38419f44319bc4b787e4cf29bb', 'request_id': 'req-d4998770-5c06-49d5-b992-2de767cf2665'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:51.129103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] The token cache is being invalidate because project f2874e38419f44319bc4b787e4cf29bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:51.129497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:51.130576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-d4998770-5c06-49d5-b992-2de767cf2665 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:51.134559 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1100/2199] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:50 2022] DELETE /identity/v3/projects/f2874e38419f44319bc4b787e4cf29bb => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:51.140907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.142340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.142837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.247963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:51.250785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:51.427112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1100/2200] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:51.440547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.440997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.441419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.478713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:51.480951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:51.497960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1101/2201] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:51.504832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:51.525935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266776f-7d8f-4359-8a83-035c7bf7213e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:51.535083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:51.536410 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.538171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.538742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.540270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:51.540804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:51.544469 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:51.574282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1101/2202] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:51.580253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:51.597397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c291f86d-1f77-465c-a510-e44794c160ad None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:51.605981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:51.607335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.607508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.607931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.609045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:51.612422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:51.669093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1102/2203] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:51 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:51.675368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:51.727344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3555c01d-27e5-47ff-b732-cd5978e1467d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:51.885338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:51.887118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.888312 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.889169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.890843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:51.895006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:51.938355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1102/2204] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:51 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:51.943410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:51.966894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54130e7-c406-44b7-8c6b-84e176e203d8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:51.979490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:51.981148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:51.981824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:51.982506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:51.984113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:51.987566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.022851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1103/2205] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:52.029325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.054506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e7279-cd41-469e-aef6-3efc4499c75f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.063601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.064992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.065629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.066268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.068073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:52.074087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832ced54-826e-4517-951a-f9119af84422 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.095979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1103/2206] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:52.103443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.124105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb762aa4-1d09-455c-b474-9e1196f3307a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.130722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.131961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.132237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.132511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] PATH_INFO: `/v3/projects/975a37dc045d44cb8ec93728ae2995c8/users/9c089bdbe6df49078068d1d5865dae9f/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.153392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=975a37dc045d44cb8ec93728ae2995c8, user_id=9c089bdbe6df49078068d1d5865dae9f, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:52.156179 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb495f94-176f-449e-b5a5-8db06a08e9ee admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.184036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1104/2207] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:52 2022] PUT /identity/v3/projects/975a37dc045d44cb8ec93728ae2995c8/users/9c089bdbe6df49078068d1d5865dae9f/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:52.195250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.196194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.196505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.233663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] MFA Rules not processed for user `9c089bdbe6df49078068d1d5865dae9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:52.235197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:52.332300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.332779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.333145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.339462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:52.378251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] MFA Rules not processed for user `04ec0ae1329c4e6cac12edeb556af858`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:52.381095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:52.403658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1104/2208] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:52.404838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.416218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:52.497476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1105/2209] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:52 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:52.518788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.519143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff53afc-ffbe-472b-a5fc-d98980791093 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.524122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:52.528744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.530424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.531176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.532084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.533596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:52.538172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.609575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1105/2210] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:52 2022] POST /identity/v3/projects => generated 381 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:52.611548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.640807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f0c80-9d4d-4e70-a47f-521343dc07d8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.751711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.752539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.766531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.767151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.771202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:52.772750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7b6d1-8ac6-420b-9990-b605515693cc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.781219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.782606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.783104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.783571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.784976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:52.789233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.842133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1106/2211] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:52 2022] POST /identity/v3/users => generated 297 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:52.848849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:52.894027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652c1a0-2fc2-4913-89dc-bb8ed07d936d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:52.917657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:52.920417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:52.922349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:52.922820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:52.924137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:52.936115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:52.985829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1107/2212] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:52.986439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:53.015443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a2cf-f526-47ea-9dd8-93185f7ffd35 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:53.025629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:53.027488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:53.028419 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:53.028864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] PATH_INFO: `/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d/users/53fb5086d1a246ac80d8a2dda6a5fd7e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:53.069266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:53.072328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:53.101764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbc6b39e0d542e9a3d58bb41051da8d, user_id=53fb5086d1a246ac80d8a2dda6a5fd7e, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:53.109948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:53.123977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1106/2213] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:53.170846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1108/2214] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:52 2022] PUT /identity/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d/users/53fb5086d1a246ac80d8a2dda6a5fd7e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:53.176280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:53.192555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62369af6-450e-49a6-834c-0452f6bae36f service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:53.310647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:53.459546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:53.463420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:53.464744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:53.467772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:53.474581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:53.482500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf3b04-8bcb-4815-b3a5-5adc5df0154d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:53.526149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1107/2215] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:53.533112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:53.559722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7066b40-b1cd-4019-91e1-6cb01f24e2a7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:53.574296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:53.575856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:53.576316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:53.576765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] PATH_INFO: `/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d/users/53fb5086d1a246ac80d8a2dda6a5fd7e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:53.584663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecbc6b39e0d542e9a3d58bb41051da8d, user_id=53fb5086d1a246ac80d8a2dda6a5fd7e, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:53.596031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:53.607882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:53.647398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1109/2216] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:53 2022] PUT /identity/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d/users/53fb5086d1a246ac80d8a2dda6a5fd7e/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:53.652959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:53.653527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:53.654235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:53.719492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] MFA Rules not processed for user `53fb5086d1a246ac80d8a2dda6a5fd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:53.722461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:53.914465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1108/2217] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:53.936160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:53.939860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:54.157621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c2594-a4c3-4da4-b0c4-d6b4877c616c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:54.161909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:54.163557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:54.163557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:54.163557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:54.179380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:54.182380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:54.201537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1110/2218] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:37:54.736743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:54.748318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2e3584-ed1e-43b3-86a7-8294a30fa60f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:54.754395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fb5086d1a246ac80d8a2dda6a5fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:54.755226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:54.755571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:54.755958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:54.757381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:54.757684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:54.760007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:54.777133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1109/2219] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:54.781486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:54.793391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98194c0d-a83e-4a0d-a85d-3f9a86d41f0a service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:54.799729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fb5086d1a246ac80d8a2dda6a5fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:54.800308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:54.800569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:54.800911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:54.801849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:54.804342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:54.848573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1111/2220] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:54 2022] POST /identity/v3/projects => generated 354 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:54.854365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:54.869056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e1ba1-44fb-47f1-b857-81ba71142de5 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:54.992875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fb5086d1a246ac80d8a2dda6a5fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:54.994203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:54.994618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:54.995103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:54.996849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:54.997343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:55.000961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:55.033308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1110/2221] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:37:55.106450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:55.118036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ea52-52d7-4996-8f06-4dd013b6ae74 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:55.123231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53fb5086d1a246ac80d8a2dda6a5fd7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:55.124129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:55.124422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:55.124751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] PATH_INFO: `/v3/projects/209cac8fb2eb4432ba3b93ad2fc727c2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:55.126188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorizing `identity:delete_project(project_id=209cac8fb2eb4432ba3b93ad2fc727c2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:55.128232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:55.144118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:55.188868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:55.195207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209cac8fb2eb4432ba3b93ad2fc727c2', 'request_id': 'req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.213135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209cac8fb2eb4432ba3b93ad2fc727c2', 'request_id': 'req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.242373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209cac8fb2eb4432ba3b93ad2fc727c2', 'request_id': 'req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.249841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8d226d-8d37-49c0-bb82-32a235693e02 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:55.272775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] The token cache is being invalidate because project 209cac8fb2eb4432ba3b93ad2fc727c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:55.272987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.275297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.286583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1112/2222] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:55 2022] DELETE /identity/v3/projects/209cac8fb2eb4432ba3b93ad2fc727c2 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:55.402012 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:55.402952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:55.406401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:55.406966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:55.411628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:55.616696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:55.619447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549ab1b5-4570-4ea0-bb88-5c4a3a559067 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:55.650597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1111/2223] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:55 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:55.660396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:55.663962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:55.793711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:55.813132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4ecf2-c437-4511-b1e7-7f48e76231e2 tempest-VolumeQuotaClassesTest-1326293441 tempest-VolumeQuotaClassesTest-1326293441-project-admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:55.823773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:55.825697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:55.826501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:55.827201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] PATH_INFO: `/v3/users/9c089bdbe6df49078068d1d5865dae9f` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:55.830292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c089bdbe6df49078068d1d5865dae9f)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:55.833769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:55.962705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c089bdbe6df49078068d1d5865dae9f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.982487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c089bdbe6df49078068d1d5865dae9f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.983273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c089bdbe6df49078068d1d5865dae9f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.996039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c089bdbe6df49078068d1d5865dae9f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:55.997777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c089bdbe6df49078068d1d5865dae9f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:56.037625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1113/2224] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:55 2022] DELETE /identity/v3/users/9c089bdbe6df49078068d1d5865dae9f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:56.043538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:56.044121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:56.044755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:56.077407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:56.080079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:56.242950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1112/2225] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:56.272929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:56.274986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:56.511041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a602e1-32a3-4c84-8793-9f72c0647c99 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:56.537377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:56.538912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:56.539689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:56.540418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:56.559374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:56.562653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:56.585862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1114/2226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:37:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:37:57.442609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:57.445711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:57.473400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5dd992-d4ed-4c89-b864-275e9be4604e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:57.493468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:57.494396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:57.494718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:57.495008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] PATH_INFO: `/v3/projects/975a37dc045d44cb8ec93728ae2995c8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:57.496294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] RBAC: Authorizing `identity:delete_project(project_id=975a37dc045d44cb8ec93728ae2995c8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:57.498431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:57.576777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:57.621396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '975a37dc045d44cb8ec93728ae2995c8', 'request_id': 'req-dd5fa615-9090-4424-b841-4bbaa1d11046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.647018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '975a37dc045d44cb8ec93728ae2995c8', 'request_id': 'req-dd5fa615-9090-4424-b841-4bbaa1d11046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.659112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '975a37dc045d44cb8ec93728ae2995c8', 'request_id': 'req-dd5fa615-9090-4424-b841-4bbaa1d11046'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.677836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] The token cache is being invalidate because project 975a37dc045d44cb8ec93728ae2995c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:57.678752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.681229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.689128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1113/2227] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:57 2022] DELETE /identity/v3/projects/975a37dc045d44cb8ec93728ae2995c8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:57.689749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:57.715013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496ab5-bfac-4c5e-a10f-65c42a00831c service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:57.877580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:57.878588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:57.878908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:57.879184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] PATH_INFO: `/v3/users/53fb5086d1a246ac80d8a2dda6a5fd7e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:57.880567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fb5086d1a246ac80d8a2dda6a5fd7e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:57.882773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:57.920557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:57.975331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fb5086d1a246ac80d8a2dda6a5fd7e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.995364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fb5086d1a246ac80d8a2dda6a5fd7e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:57.996525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fb5086d1a246ac80d8a2dda6a5fd7e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.010372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fb5086d1a246ac80d8a2dda6a5fd7e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.011324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a67cf1a9-5dd6-4a82-b79b-97d21b628386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fb5086d1a246ac80d8a2dda6a5fd7e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.044741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1115/2228] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:37:57 2022] DELETE /identity/v3/users/53fb5086d1a246ac80d8a2dda6a5fd7e => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:58.471602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:58.475278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:58.511248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fa615-9090-4424-b841-4bbaa1d11046 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:58.676883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:58.679330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:58.684394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:58.685926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] PATH_INFO: `/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:58.689631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecbc6b39e0d542e9a3d58bb41051da8d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:58.692178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:58.849707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'request_id': 'req-a2a9167c-158e-4171-a1cb-c13589c37924'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.863702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'request_id': 'req-a2a9167c-158e-4171-a1cb-c13589c37924'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.874889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecbc6b39e0d542e9a3d58bb41051da8d', 'request_id': 'req-a2a9167c-158e-4171-a1cb-c13589c37924'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.890445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] The token cache is being invalidate because project ecbc6b39e0d542e9a3d58bb41051da8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:37:58.890943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.891693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a2a9167c-158e-4171-a1cb-c13589c37924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:37:58.910569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1114/2229] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:37:58 2022] DELETE /identity/v3/projects/ecbc6b39e0d542e9a3d58bb41051da8d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:37:58.911396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:58.912150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:58.912150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:58.938848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:58.940633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:59.077903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1116/2230] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:59.091050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.092051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.092764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.116886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:59.118638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:37:59.133032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1115/2231] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:37:59.133520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.152843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75b9d18-2b5f-4f3c-ac55-9d0999d65344 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.163087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.164109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.164590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.165193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.166192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:37:59.166707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.171824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.212622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1117/2232] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:37:59.218630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.231228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2322ea-6227-42a3-9faa-976e517bde22 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.239209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.240131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.240721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.241330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.243081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.249255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.427740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1116/2233] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:37:59 2022] POST /identity/v3/projects => generated 361 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:37:59.428786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.466124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf8a5d8-0e17-4608-9e65-0ff4d90b2b1c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.639307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.640461 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.640887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.642201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.642642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.646493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.677790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1118/2234] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:37:59 2022] POST /identity/v3/users => generated 281 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:37:59.684025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.696461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad57b07c-0f9f-4f75-8505-2b731481a20d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.702139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.703123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.703589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.704400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.705422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.707302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.720653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1117/2235] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:37:59.727370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.743438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71b8c3-f116-4078-b48a-144ddca8074c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.753480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.755178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.755672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.756153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.758112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.760234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bd792-b3db-4224-908c-aee68bb73a9d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.781031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1119/2236] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:37:59.782434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:37:59.794567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56db29-a1c9-45e5-93da-be1bd6cb0ce7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:37:59.800932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:37:59.801902 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.802322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.802713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] PATH_INFO: `/v3/projects/b0ba6510911c4f41abdb3cb7c8c4f59e/users/2802b5a79d7246908b576044728484ea/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.807466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:59.825319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0ba6510911c4f41abdb3cb7c8c4f59e, user_id=2802b5a79d7246908b576044728484ea, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:37:59.828648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:37:59.856091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1118/2237] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:37:59 2022] PUT /identity/v3/projects/b0ba6510911c4f41abdb3cb7c8c4f59e/users/2802b5a79d7246908b576044728484ea/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:37:59.874371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:37:59.875708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:37:59.876247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:37:59.893029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:37:59.941447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] MFA Rules not processed for user `2802b5a79d7246908b576044728484ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:37:59.944979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:00.055132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1120/2238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:37:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:00.092481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:00.095967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:00.178306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:00.180493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:00.212375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec0946-bcd1-4195-ba99-a4473e855788 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:00.216492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:00.217173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:00.217458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:00.217737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:00.231034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:00.234003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:00.248149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1119/2239] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:00.264737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:00.266843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818032e-bfe0-4743-8d2f-7378a2233b0a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:00.272272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:00.273202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:00.273497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:00.273779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] PATH_INFO: `/v3/users/5a3a6c87dbcb41eba4597f8a16651ecc` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:00.275281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3a6c87dbcb41eba4597f8a16651ecc)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:00.277350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:00.279029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472603af-a01f-40d4-87a5-546d050c68ac service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:00.284868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:00.285825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:00.286143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:00.286424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] PATH_INFO: `/v3/users/2802b5a79d7246908b576044728484ea` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:00.287827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2802b5a79d7246908b576044728484ea)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:00.289958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:00.351832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3a6c87dbcb41eba4597f8a16651ecc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.369380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3a6c87dbcb41eba4597f8a16651ecc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.370429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3a6c87dbcb41eba4597f8a16651ecc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.386750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3a6c87dbcb41eba4597f8a16651ecc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.387670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-5f95f27b-9ef8-4c3f-8535-4aa0d0c35fab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3a6c87dbcb41eba4597f8a16651ecc'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.410480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2802b5a79d7246908b576044728484ea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.414696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1121/2240] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:00 2022] DELETE /identity/v3/users/5a3a6c87dbcb41eba4597f8a16651ecc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:00.434147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2802b5a79d7246908b576044728484ea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.452796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2802b5a79d7246908b576044728484ea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.453644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2802b5a79d7246908b576044728484ea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.466031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2802b5a79d7246908b576044728484ea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:00.483045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1120/2241] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:00 2022] DELETE /identity/v3/users/2802b5a79d7246908b576044728484ea => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:00.488894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:00.489721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:00.490358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:00.513697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:00.515568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:00.541722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:00.639486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1122/2242] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:00.661915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:00.663793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:00.806203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd282bc-f068-4181-8210-93ca27d78bd6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:00.816237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:00.818185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:00.818907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:00.820407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:00.846417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:00.849642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6784edaf-b2e3-4ba1-9af7-222bf5bcac8d service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:00.871886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1121/2243] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:01.013974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.017096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:01.053107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d031a6-3149-48fe-b463-5144d73046a1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.066083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.068475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.069404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.070139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] PATH_INFO: `/v3/projects/b76f6f1219f94a24b5015fb819a67ed6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.072775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76f6f1219f94a24b5015fb819a67ed6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.075893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.172349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76f6f1219f94a24b5015fb819a67ed6', 'request_id': 'req-84448a83-62d6-44d4-8bec-2677526700a6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.180312 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76f6f1219f94a24b5015fb819a67ed6', 'request_id': 'req-84448a83-62d6-44d4-8bec-2677526700a6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.189328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76f6f1219f94a24b5015fb819a67ed6', 'request_id': 'req-84448a83-62d6-44d4-8bec-2677526700a6'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.211451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] The token cache is being invalidate because project b76f6f1219f94a24b5015fb819a67ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:01.212025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.212566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-84448a83-62d6-44d4-8bec-2677526700a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.214977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1123/2244] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:01 2022] DELETE /identity/v3/projects/b76f6f1219f94a24b5015fb819a67ed6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:01.223319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.224306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.225827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.235594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:01.271919 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:01.276461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:01.385276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1122/2245] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:01.394564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.394890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.395118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.422894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:01.424987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:01.434891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1124/2246] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:01.439735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.454616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e77bd3-c1ed-4a00-8b04-e8b0df0d6a3d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.461079 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.461776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.462087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.462375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.463211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:01.463520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.465190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.480509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1123/2247] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:01.486346 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.497863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208a45c-8d64-45a3-84f2-cf43dfe3eb7e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.503248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.504194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.504480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.504758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.505715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.508490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.550270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1125/2248] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:01.552506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.573496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a3b70-486d-4427-b1c8-8d6b181924c9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.678865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.680395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.681560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.681560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.683035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.685243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.716442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1124/2249] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:01.717657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.732021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8e8de-452f-4bc8-aad4-92faa1402065 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.740319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.741947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.742482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.742970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.744339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.747493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.774034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1126/2250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:01.778584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.787627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.789856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:01.798922 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c5e99-bcf3-4e19-9b12-34ee44ba1388 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.806776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f19837-c9c8-4d3c-bb4e-a0c4678d3db2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.808232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.809526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.810127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.810581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.811771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.813722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.814738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.814906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.815069 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.815569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] PATH_INFO: `/v3/projects/b0ba6510911c4f41abdb3cb7c8c4f59e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.817543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0ba6510911c4f41abdb3cb7c8c4f59e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.819993 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.832702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1125/2251] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:01.839062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:01.852220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c33e-5de5-4c10-aed3-caffd207001c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:01.859111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:01.860096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.860412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.860695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] PATH_INFO: `/v3/projects/d45d0abe324c4bfe96658885be4430a3/users/8bda78d72760411c98ba8e2d358999a9/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.885516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d45d0abe324c4bfe96658885be4430a3, user_id=8bda78d72760411c98ba8e2d358999a9, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:01.890989 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59bda04-e69b-4084-b1cd-b9d020b06854 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:01.897014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0ba6510911c4f41abdb3cb7c8c4f59e', 'request_id': 'req-97dc0362-490a-4842-801a-ba6636c9e38f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.900606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:01.908995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0ba6510911c4f41abdb3cb7c8c4f59e', 'request_id': 'req-97dc0362-490a-4842-801a-ba6636c9e38f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.915432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1126/2252] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:01 2022] PUT /identity/v3/projects/d45d0abe324c4bfe96658885be4430a3/users/8bda78d72760411c98ba8e2d358999a9/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:01.922450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0ba6510911c4f41abdb3cb7c8c4f59e', 'request_id': 'req-97dc0362-490a-4842-801a-ba6636c9e38f'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.933013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.933507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.933930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.943938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] The token cache is being invalidate because project b0ba6510911c4f41abdb3cb7c8c4f59e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:01.944460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.946037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-97dc0362-490a-4842-801a-ba6636c9e38f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:01.949327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1127/2253] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:01 2022] DELETE /identity/v3/projects/b0ba6510911c4f41abdb3cb7c8c4f59e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:01.957075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2690f-7a85-4bbd-8fc3-e0c607f97d66 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:01.957525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2690f-7a85-4bbd-8fc3-e0c607f97d66 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:01.957928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa2690f-7a85-4bbd-8fc3-e0c607f97d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:01.979183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] MFA Rules not processed for user `8bda78d72760411c98ba8e2d358999a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:01.982405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:02.006880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-aaa2690f-7a85-4bbd-8fc3-e0c607f97d66 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:02.009263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aaa2690f-7a85-4bbd-8fc3-e0c607f97d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:02.062105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:02.136850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1127/2254] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:02.151996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.157553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:02.183695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1128/2255] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:02.187799 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.189713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.190612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.236008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:02.237262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:02.248030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1129/2256] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:02.252853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.273175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff9ef-de9c-4e58-90ea-94feec1e6e95 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.280087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.280956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.281359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.281728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.284037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:02.284037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.286109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.312427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1130/2257] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:02.316315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.333383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4ca893-9ac9-416b-8acb-08b62be65af3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.340982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.344891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.345415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.345847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.346937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.350605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.369536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f266b0d-06fc-4312-9d12-03c203b72be9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.378358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.379815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.380335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.380909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.394630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.403841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1131/2258] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:02 2022] POST /identity/v3/projects => generated 361 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:02.413074 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.415085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.446960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1128/2259] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:02.569988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8ab41-9106-4555-aef1-321e48dac6f7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.575887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.576631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.576992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.577277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.578602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.581547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.623947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1132/2260] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:02 2022] POST /identity/v3/users => generated 281 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:02.628549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.641723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427f6ad-f7a9-4cf5-a37a-db6f76205edb service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.647560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.649152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.649494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.649852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.651308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.652962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.671020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.680244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1129/2261] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:02.684992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4fcdac-eea1-4ef4-94b2-240800e1d954 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.695154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.696015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.696505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.697049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.697917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.700023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57eeb69-9739-40a8-b59c-a2254cc263d9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.719646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1133/2262] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:02.725041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:02.736915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4437c-2914-4c83-9172-3aa000946a80 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:02.743384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:02.744346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.744622 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.744898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] PATH_INFO: `/v3/projects/e869eda0b6354565b8854d48032f318e/users/93c4ce6932c84fc7acadd6583dd895c7/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.780660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e869eda0b6354565b8854d48032f318e, user_id=93c4ce6932c84fc7acadd6583dd895c7, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:02.783598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:02.806283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1130/2263] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:02 2022] PUT /identity/v3/projects/e869eda0b6354565b8854d48032f318e/users/93c4ce6932c84fc7acadd6583dd895c7/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:02.817755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:02.818284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:02.818639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:02.867064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:02.926974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] MFA Rules not processed for user `93c4ce6932c84fc7acadd6583dd895c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:02.930152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:03.107830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1134/2264] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:03.137507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:03.139640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:03.273970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4cea3-4cf9-4adb-8b8a-3a9b190cb29d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:03.303451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:03.308970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:03.310603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:03.314906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:03.354076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:03.358619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853ee75-85a3-4c0f-ad6b-1df6ca6a1159 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:03.398496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1131/2265] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:13.098814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=28 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:13.378043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=87,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:15.087256 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:15.088827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:15.166762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c9b256-e0ab-4d36-ade9-e0b0f1163fe8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:15.175109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:15.176016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:15.176293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:15.176565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] PATH_INFO: `/v3/users/8bda78d72760411c98ba8e2d358999a9` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:15.177837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bda78d72760411c98ba8e2d358999a9)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:15.179858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:15.247418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bda78d72760411c98ba8e2d358999a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:15.260201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bda78d72760411c98ba8e2d358999a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:15.261508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bda78d72760411c98ba8e2d358999a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:15.272715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bda78d72760411c98ba8e2d358999a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:15.273689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bda78d72760411c98ba8e2d358999a9'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:15.302968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1135/2266] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:15 2022] DELETE /identity/v3/users/8bda78d72760411c98ba8e2d358999a9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:15.307577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84c43-0741-4818-af9f-37056e358e74 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:15.308178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84c43-0741-4818-af9f-37056e358e74 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:15.308359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f84c43-0741-4818-af9f-37056e358e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:15.327145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-04f84c43-0741-4818-af9f-37056e358e74 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:15.328986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-04f84c43-0741-4818-af9f-37056e358e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:15.466809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1132/2267] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:15.482592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:15.484603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:15.596029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ce9d9-0c9a-4018-b839-fcda863ea9e5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:15.602530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:15.603212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:15.603493 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:15.603777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:15.614403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:15.616006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:15.631838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1136/2268] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:15.838005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d69c4-a97e-49cf-adc4-2f1839538cfe None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:15.838255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d69c4-a97e-49cf-adc4-2f1839538cfe None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:15.838566 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d69c4-a97e-49cf-adc4-2f1839538cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:15.863793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-362d69c4-a97e-49cf-adc4-2f1839538cfe None None] MFA Rules not processed for user `0e92ccbb22394817bd8a4224cc0d4e13`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:15.866295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-362d69c4-a97e-49cf-adc4-2f1839538cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:15.937322 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1133/2269] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:15.975362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:15.977240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:15.997061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af2918a-3232-439c-9238-e0029e879362 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.003334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.004272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.004594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.004819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] PATH_INFO: `/v3/projects/d45d0abe324c4bfe96658885be4430a3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.006990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d45d0abe324c4bfe96658885be4430a3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.009639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.038502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:16.101231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd45d0abe324c4bfe96658885be4430a3', 'request_id': 'req-69e8b218-2763-481c-8ea8-181d22766265'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:16.101231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd45d0abe324c4bfe96658885be4430a3', 'request_id': 'req-69e8b218-2763-481c-8ea8-181d22766265'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:16.107107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd45d0abe324c4bfe96658885be4430a3', 'request_id': 'req-69e8b218-2763-481c-8ea8-181d22766265'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:16.132791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] The token cache is being invalidate because project d45d0abe324c4bfe96658885be4430a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:16.133225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:16.135011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-69e8b218-2763-481c-8ea8-181d22766265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:16.140573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1137/2270] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:15 2022] DELETE /identity/v3/projects/d45d0abe324c4bfe96658885be4430a3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:16.142915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.143243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.143527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.167893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:16.171483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:16.290385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1134/2271] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:16.300619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.301102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.301532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.335816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:16.337225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:16.348632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1138/2272] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:16.355905 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.383662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e92d2b-ea0c-4825-b86e-6964d3d99389 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.393461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.394294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.396993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.396993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.398705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:16.399054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.400967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.417244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1135/2273] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:16.422710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.439861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a930ab-6f1f-4380-9731-752abac82f30 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.447273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.448021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.448381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.448603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.449657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.452065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.487730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1139/2274] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:16 2022] POST /identity/v3/projects => generated 389 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:16.492794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.512705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef9202-0cb8-4af7-a972-774dfeccffc2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.582021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:16.696095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.697164 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.697597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.698013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.699109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.701307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.748678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1136/2275] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:16 2022] POST /identity/v3/users => generated 295 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:16.753190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.784139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f3241e-7dd2-46ad-9c76-ebd3292fef2a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.803323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.808119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.810555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.812033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.815064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.825533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.847436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1140/2276] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:16.848554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.870961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea084b4-940d-4d7b-97d9-07479509a000 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.889048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.889918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.890471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.891463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:16.893972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:16.897338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ad086-5a2e-4f2c-8230-7e8a18fd81fa admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:16.940759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1137/2277] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:16.944043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:16.956784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8445734-9afc-4e85-bf35-2dcc4c0c7957 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:16.967720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:16.969040 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:16.969383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:16.969759 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] PATH_INFO: `/v3/projects/7ff9cbc75aa94eada0a912ee30fe48b4/users/f72f5fabb301409fbdb105815522dd90/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.002094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff9cbc75aa94eada0a912ee30fe48b4, user_id=f72f5fabb301409fbdb105815522dd90, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.005202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.030927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1141/2278] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:16 2022] PUT /identity/v3/projects/7ff9cbc75aa94eada0a912ee30fe48b4/users/f72f5fabb301409fbdb105815522dd90/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:17.041889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.042249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.042486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.091375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] MFA Rules not processed for user `f72f5fabb301409fbdb105815522dd90`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:17.092734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:17.197768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1138/2279] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:17.204213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.339555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce445e90-31c4-4881-81f5-d6d3a1fbe54a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.345026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.346251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.346251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.346616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.347554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.349793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.392719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1142/2280] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:17 2022] POST /identity/v3/projects => generated 389 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:17.398353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.416602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb9c12-7052-4b10-b7f2-2f02625aa277 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.512824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.513811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.514134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.514485 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.515255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.517431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.543520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1139/2281] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:17 2022] POST /identity/v3/users => generated 301 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:17.549392 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.566762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fb833-0f55-48ba-9a37-e4ffdc648c92 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.573607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.573607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.573607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.574198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.574649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.576324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.590145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1143/2282] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:17.594810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.606661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0752541-e13b-4201-9f2e-e97243145c9b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.613255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.614351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.614666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.614947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] PATH_INFO: `/v3/projects/6561677ed64f48ff8c8611c9294778c6/users/03e0ab9f036243c192909d2737f5e93d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.637118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6561677ed64f48ff8c8611c9294778c6, user_id=03e0ab9f036243c192909d2737f5e93d, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.640332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.658521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1140/2283] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:17 2022] PUT /identity/v3/projects/6561677ed64f48ff8c8611c9294778c6/users/03e0ab9f036243c192909d2737f5e93d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:17.662668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.673750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc378a-b067-4f2c-afbd-a5ec0725a153 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.688398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:17.782194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.785379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.785379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.785379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.785935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.789042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438d79e2-7ec3-4c7f-b105-ac39bd397834 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.816573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1144/2284] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:17.819437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:17.840846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b6bce-701a-4569-8252-86d0397f3e60 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:17.850308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:17.851355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.851844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.852339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] PATH_INFO: `/v3/projects/6561677ed64f48ff8c8611c9294778c6/users/03e0ab9f036243c192909d2737f5e93d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.855646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6561677ed64f48ff8c8611c9294778c6, user_id=03e0ab9f036243c192909d2737f5e93d, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:17.859092 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:17.862329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:17.874196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1141/2285] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:17 2022] PUT /identity/v3/projects/6561677ed64f48ff8c8611c9294778c6/users/03e0ab9f036243c192909d2737f5e93d/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:17.888481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:17.888763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:17.889110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:17.926745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] MFA Rules not processed for user `03e0ab9f036243c192909d2737f5e93d`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:17.928698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.076363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1145/2286] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:18.088360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:18.090122 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.175679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad60d1-d4f8-45ac-aa97-e1c673cbec75 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:18.179484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:18.180153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.180420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.180700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.191220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:18.193195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:18.206708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1142/2287] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:18.405662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:18.510955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:18.512262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.528824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcda61c-51ff-408d-bbb7-e50514121799 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:18.534758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:18.535747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab5bbc8-0b54-4118-95f4-1545ab8a3013 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:18.535866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.538612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.538926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] PATH_INFO: `/v3/users/0ec8a1dcfac145fa8ec89d3d439ce294` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.542746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec8a1dcfac145fa8ec89d3d439ce294)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:18.545199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:18.546795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:18.548340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.548844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.549342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] PATH_INFO: `/v3/users/f72f5fabb301409fbdb105815522dd90` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.551722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72f5fabb301409fbdb105815522dd90)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:18.557271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:18.616338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:18.622776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec8a1dcfac145fa8ec89d3d439ce294'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.624445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72f5fabb301409fbdb105815522dd90'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.632712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72f5fabb301409fbdb105815522dd90'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.633820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72f5fabb301409fbdb105815522dd90'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.634621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec8a1dcfac145fa8ec89d3d439ce294'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.643887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72f5fabb301409fbdb105815522dd90'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.644562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-93886a42-fb52-4d99-b5d9-90502b8d83b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72f5fabb301409fbdb105815522dd90'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.655933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec8a1dcfac145fa8ec89d3d439ce294'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.656687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec8a1dcfac145fa8ec89d3d439ce294'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.666295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec8a1dcfac145fa8ec89d3d439ce294'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:18.666614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1146/2288] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:18 2022] DELETE /identity/v3/users/f72f5fabb301409fbdb105815522dd90 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:18.671228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.671605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.671988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.676588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1143/2289] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:18 2022] DELETE /identity/v3/users/0ec8a1dcfac145fa8ec89d3d439ce294 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:18.692468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:18.694126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.781231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1147/2290] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:18.796403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:18.798361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.870933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bd58e-e743-4c93-b031-c7dd4a22ed12 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:18.875531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:18.876302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.876727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.877202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.889537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:18.892492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:18.911591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1144/2291] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:18.926709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:18.928874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:18.943634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7aeb75-49fa-4364-9ad9-a43fbf14a1e9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:18.963383 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:18.964381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:18.964643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:18.964976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] PATH_INFO: `/v3/projects/d3f45b6964464b3788e5b36946aa2089` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:18.967116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f45b6964464b3788e5b36946aa2089)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:18.971187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:19.045407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f45b6964464b3788e5b36946aa2089', 'request_id': 'req-802fbafe-11d7-45f3-bcc3-9215e518cc5c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.055222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f45b6964464b3788e5b36946aa2089', 'request_id': 'req-802fbafe-11d7-45f3-bcc3-9215e518cc5c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.063623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f45b6964464b3788e5b36946aa2089', 'request_id': 'req-802fbafe-11d7-45f3-bcc3-9215e518cc5c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.084682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] The token cache is being invalidate because project d3f45b6964464b3788e5b36946aa2089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:19.085021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.085882 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.087528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1148/2292] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:18 2022] DELETE /identity/v3/projects/d3f45b6964464b3788e5b36946aa2089 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:19.092173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:19.106960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6cfed5-69f3-4341-8d4a-39365cb5d2c4 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:19.126762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:19.224205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:19.225813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:19.226685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:19.227214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] PATH_INFO: `/v3/users/04ec0ae1329c4e6cac12edeb556af858` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:19.229448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04ec0ae1329c4e6cac12edeb556af858)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:19.233433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:19.319201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ec0ae1329c4e6cac12edeb556af858'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.331963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ec0ae1329c4e6cac12edeb556af858'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.353163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ec0ae1329c4e6cac12edeb556af858'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.354365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ec0ae1329c4e6cac12edeb556af858'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.368157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ec0ae1329c4e6cac12edeb556af858'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.378609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:19.381099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1145/2293] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:19 2022] DELETE /identity/v3/users/04ec0ae1329c4e6cac12edeb556af858 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:19.381357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:19.419635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802fbafe-11d7-45f3-bcc3-9215e518cc5c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:19.481273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:19.508939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:19.509848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:19.510164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:19.510432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] PATH_INFO: `/v3/projects/7ff9cbc75aa94eada0a912ee30fe48b4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:19.513427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff9cbc75aa94eada0a912ee30fe48b4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:19.516293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:19.590536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff9cbc75aa94eada0a912ee30fe48b4', 'request_id': 'req-22467fba-6971-4cbe-b649-aa78c9a83549'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.602707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff9cbc75aa94eada0a912ee30fe48b4', 'request_id': 'req-22467fba-6971-4cbe-b649-aa78c9a83549'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.612908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff9cbc75aa94eada0a912ee30fe48b4', 'request_id': 'req-22467fba-6971-4cbe-b649-aa78c9a83549'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.644189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] The token cache is being invalidate because project 7ff9cbc75aa94eada0a912ee30fe48b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:19.644576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.645627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.648254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1149/2294] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:19 2022] DELETE /identity/v3/projects/7ff9cbc75aa94eada0a912ee30fe48b4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:19.653696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:19.656205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:19.680374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b13ac-efa0-46c3-a406-ad77e0de4225 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:19.815971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:19.817650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:19.818385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:19.818876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] PATH_INFO: `/v3/users/03e0ab9f036243c192909d2737f5e93d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:19.821427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e0ab9f036243c192909d2737f5e93d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:19.825648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:19.838399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:19.844233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:19.871551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22467fba-6971-4cbe-b649-aa78c9a83549 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:19.881487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:19.883202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:19.883859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:19.884434 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] PATH_INFO: `/v3/projects/d635f5494d5443ee9daca435f41d25b9` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:19.887430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d635f5494d5443ee9daca435f41d25b9)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:19.891612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:19.902679 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:19.922912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e0ab9f036243c192909d2737f5e93d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.934531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e0ab9f036243c192909d2737f5e93d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.959647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd635f5494d5443ee9daca435f41d25b9', 'request_id': 'req-1579018e-76cc-4345-b05c-c6dee4d20b47'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.960432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e0ab9f036243c192909d2737f5e93d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.961522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e0ab9f036243c192909d2737f5e93d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.966370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd635f5494d5443ee9daca435f41d25b9', 'request_id': 'req-1579018e-76cc-4345-b05c-c6dee4d20b47'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.973222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd635f5494d5443ee9daca435f41d25b9', 'request_id': 'req-1579018e-76cc-4345-b05c-c6dee4d20b47'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.976026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-52d58b68-00cd-48f3-8f73-87e31722b472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e0ab9f036243c192909d2737f5e93d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.985739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1146/2295] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:19 2022] DELETE /identity/v3/users/03e0ab9f036243c192909d2737f5e93d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:19.991033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] The token cache is being invalidate because project d635f5494d5443ee9daca435f41d25b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:19.991033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.992071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1579018e-76cc-4345-b05c-c6dee4d20b47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:19.993856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1150/2296] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:19 2022] DELETE /identity/v3/projects/d635f5494d5443ee9daca435f41d25b9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:20.003852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.004187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.004409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.026339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:20.028190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.116849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1147/2297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:20.131679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.132187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.132533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.166504 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:20.168667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.190892 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1151/2298] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:20.193305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.211957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2ce1d-399a-4480-8916-bb497b9526aa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.230113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.230113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.230113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.230113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.231217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:20.231775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.235747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.262038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1148/2299] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:20.266921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.285036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953099d-d05f-4964-abb7-fda09b1628a4 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.290512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.291202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.291487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.291765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.293966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.295113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.329415 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1152/2300] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:20.334259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.346321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4dd8b1-d763-4804-b455-2a0f30a3367f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.440620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.443306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.447948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.449368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.450118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.450814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.452064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.456736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.461242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce3c009-d738-4427-a995-d20483ff49c3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.466887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.467803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.468098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.468369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] PATH_INFO: `/v3/projects/6561677ed64f48ff8c8611c9294778c6` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.469870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6561677ed64f48ff8c8611c9294778c6)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.471983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.498184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1149/2301] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:20.499676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.503270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:20.511896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78727b-acdf-41aa-948e-cba5eff62868 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.517849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.518681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.519048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.519394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.520372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.522230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.534753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1150/2302] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:20.546538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6561677ed64f48ff8c8611c9294778c6', 'request_id': 'req-a12740c4-6022-4382-ad15-73dfb833848e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:20.546888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.553350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6561677ed64f48ff8c8611c9294778c6', 'request_id': 'req-a12740c4-6022-4382-ad15-73dfb833848e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:20.558745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014143d1-68ff-44ed-b8bd-7402e3c6d47d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.561591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6561677ed64f48ff8c8611c9294778c6', 'request_id': 'req-a12740c4-6022-4382-ad15-73dfb833848e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:20.574459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:20.582678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] The token cache is being invalidate because project 6561677ed64f48ff8c8611c9294778c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:20.582981 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:20.584029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a12740c4-6022-4382-ad15-73dfb833848e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:20.588563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1153/2303] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:20 2022] DELETE /identity/v3/projects/6561677ed64f48ff8c8611c9294778c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:20.596643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7e6a-0f87-44b6-b345-68013c2cc145 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.597334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7e6a-0f87-44b6-b345-68013c2cc145 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.597629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911c7e6a-0f87-44b6-b345-68013c2cc145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.624680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-911c7e6a-0f87-44b6-b345-68013c2cc145 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:20.626077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-911c7e6a-0f87-44b6-b345-68013c2cc145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.637673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.638460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.638742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.639043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.639802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.641976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.659082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1151/2304] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:20.665346 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.669146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.682705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad80e38-91b6-4f3d-9bc4-8f10d5476e0a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.688183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.689186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.689526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.689837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] PATH_INFO: `/v3/projects/57663e1299044c83a6254b384d30233c/users/0a0ef8233aef40ba9134c59e309f7c33/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.713135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57663e1299044c83a6254b384d30233c, user_id=0a0ef8233aef40ba9134c59e309f7c33, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.713772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1154/2305] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:20.717125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d51aa-a022-4ad1-b120-f26b545f7c91 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.727171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.727501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.727733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.757831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1152/2306] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:20 2022] PUT /identity/v3/projects/57663e1299044c83a6254b384d30233c/users/0a0ef8233aef40ba9134c59e309f7c33/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:20.758110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:20.758946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.768636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.769105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.769271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.802491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] MFA Rules not processed for user `0a0ef8233aef40ba9134c59e309f7c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:20.804094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:20.847838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1155/2307] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:20.852803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.863672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f9e14-f7f3-4b2a-ae37-26fee5391d54 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.871900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.872565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.876127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.876669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.877481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:20.877834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.881862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.897722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1156/2308] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:38:20.905722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.921034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e98f1-7271-4f5a-a799-c55f5288ea1f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:20.926234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:20.926925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:20.927378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:20.927733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:20.928463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:20.930514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:20.965177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1153/2309] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:20.978275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1157/2310] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/projects => generated 409 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:20.983343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.983699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:20.985211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:21.007700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:21.008753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c4133-ace3-4e52-8c2f-9f35dee55d29 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.129162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.129889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.130271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.130436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b3a4c-5227-4d9d-a8a4-a2ccb3da6bac admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.130671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.131569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.133596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.135524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.136203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.136509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.136778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.158877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1154/2311] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:20 2022] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:21.163302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.175811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca251c3-76ca-4efb-aec2-ca05b37ba608 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.181834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.182674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.183013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.183360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.184263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.186019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.187635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:21.204159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1155/2312] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:21.206249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.219401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.221165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.225710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf97813-aec0-4d53-bbb5-0bc9a3b0522a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.233678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1158/2313] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:21.233898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.235315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.235766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.236251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.238017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.241156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.258026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.267313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1156/2314] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:21.271963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.276683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328588ab-cf01-4844-84d4-e84b99acebf2 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.283742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.284160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3400fac-a5d7-4dc0-b82b-2b4627660c79 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.285148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.285568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.286015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] PATH_INFO: `/v3/users/0a0ef8233aef40ba9134c59e309f7c33` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.288238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0ef8233aef40ba9134c59e309f7c33)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.290227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.291607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.291791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.292101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.292461 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] PATH_INFO: `/v3/projects/2a1b12b9245b45b491b801fbb4640052/users/56e33f05f5224e899cf97f1a89c18388/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.312135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1b12b9245b45b491b801fbb4640052, user_id=56e33f05f5224e899cf97f1a89c18388, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.314937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de5298-5ae5-4d5f-9c6d-33967e7f8da6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.332865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1157/2315] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:21 2022] PUT /identity/v3/projects/2a1b12b9245b45b491b801fbb4640052/users/56e33f05f5224e899cf97f1a89c18388/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:21.345623 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.345941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.346245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.372695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0ef8233aef40ba9134c59e309f7c33'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:21.382747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] MFA Rules not processed for user `56e33f05f5224e899cf97f1a89c18388`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:21.384084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:21.387512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0ef8233aef40ba9134c59e309f7c33'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:21.388618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0ef8233aef40ba9134c59e309f7c33'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:21.401331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0ef8233aef40ba9134c59e309f7c33'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:21.402151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-ab72555b-a9ab-44da-9f01-0796ef53132a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0ef8233aef40ba9134c59e309f7c33'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:21.429089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1159/2316] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:21 2022] DELETE /identity/v3/users/0a0ef8233aef40ba9134c59e309f7c33 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:21.436853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.437280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.437731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.468454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:21.470507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:21.500589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:21.510186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1158/2317] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:21.515748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.518519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:21.571930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1160/2318] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:21.585492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.587153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:21.629729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768f8a9-3682-49a8-92ef-c98c743c0033 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.637687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.638778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.639257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.639739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.641021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.644661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.655585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f52b66e-6e41-40d1-8d79-1b6514769521 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.660397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.661059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.661341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.661614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.673044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.674591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.681870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1159/2319] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:21 2022] POST /identity/v3/projects => generated 409 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:21.684558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.686245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1161/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:21.737116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:21.808334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d40da6-a646-4956-bfee-a3eca1c1b2d6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.819375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.820094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.820394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.820680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.821628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.823761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.856493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1160/2321] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:21 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:21.862556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.875659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1566b-293c-4dc1-baac-a712578afb49 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.882846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.883813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.884255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.884634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.885562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.888013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:21.911609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1162/2322] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:21.916883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:21.933730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804dc70-cbe5-4615-a3fb-ec78cb869e9c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:21.938886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:21.939957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:21.940244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:21.940520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] PATH_INFO: `/v3/projects/33f9cee85907445682ec8b109c66b369/users/9bf5c5f138034ef7b0f782821f76a2ed/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:21.965261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f9cee85907445682ec8b109c66b369, user_id=9bf5c5f138034ef7b0f782821f76a2ed, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:21.972010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.000756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1161/2323] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:21 2022] PUT /identity/v3/projects/33f9cee85907445682ec8b109c66b369/users/9bf5c5f138034ef7b0f782821f76a2ed/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:22.002585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.018165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0f2ce4-88c6-4ffd-9b4b-d4710cfe7e99 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.110710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.111409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.111780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.111957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.112708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.114495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.137037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1163/2324] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:22.140051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.142608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.143638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.164460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2728d74b-c8f8-4717-b98d-662ed046db82 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.171435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.172958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.173401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.174460 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] PATH_INFO: `/v3/projects/33f9cee85907445682ec8b109c66b369/users/9bf5c5f138034ef7b0f782821f76a2ed/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.177255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f9cee85907445682ec8b109c66b369, user_id=9bf5c5f138034ef7b0f782821f76a2ed, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.180659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9a68f-a12d-45af-871b-7b4f0b2119a8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.182400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28aaa2c-6772-42d7-b9e3-90bca1db1df1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.202190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1164/2325] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:22 2022] PUT /identity/v3/projects/33f9cee85907445682ec8b109c66b369/users/9bf5c5f138034ef7b0f782821f76a2ed/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:22.202412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.205997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.206528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.208658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] PATH_INFO: `/v3/projects/57663e1299044c83a6254b384d30233c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.211374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57663e1299044c83a6254b384d30233c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.215609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.222702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.223273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.223757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.276704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] MFA Rules not processed for user `9bf5c5f138034ef7b0f782821f76a2ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:22.279957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.297949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57663e1299044c83a6254b384d30233c', 'request_id': 'req-8152d746-a339-4ecc-98c7-dd0e0af3ff54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:22.314515 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57663e1299044c83a6254b384d30233c', 'request_id': 'req-8152d746-a339-4ecc-98c7-dd0e0af3ff54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:22.329824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57663e1299044c83a6254b384d30233c', 'request_id': 'req-8152d746-a339-4ecc-98c7-dd0e0af3ff54'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:22.336871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:22.359607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] The token cache is being invalidate because project 57663e1299044c83a6254b384d30233c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:22.359607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:22.361511 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8152d746-a339-4ecc-98c7-dd0e0af3ff54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:22.364355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1162/2326] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:22 2022] DELETE /identity/v3/projects/57663e1299044c83a6254b384d30233c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:22.372201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802eb8-c3a6-4ab8-8e41-7b4aa2c06b3b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.372721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802eb8-c3a6-4ab8-8e41-7b4aa2c06b3b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.373204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c802eb8-c3a6-4ab8-8e41-7b4aa2c06b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.404321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-6c802eb8-c3a6-4ab8-8e41-7b4aa2c06b3b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:22.406450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-6c802eb8-c3a6-4ab8-8e41-7b4aa2c06b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.429088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1165/2327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:22.442994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.444795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.497830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1163/2328] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:22.507275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.507584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.507836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.534680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:22.536015 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33237993-a286-4ff2-9551-4b6a5893bc01 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.536539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.540140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.540919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.541265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.541659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.545543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1164/2329] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:22.549820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.552551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.554240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.559781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669020a-4e56-4411-878a-8f1c71146ae2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.567401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.568111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.568507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.568755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.568912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1166/2330] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:22.569462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:22.569769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.571531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.586332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1165/2331] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:38:22.590459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.603007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3afb6d-e7f4-4fbc-a5c4-31a777150105 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.607843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.608518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.608800 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.609076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.609817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.611970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.646094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1167/2332] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:22.652139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.665193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:22.672572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210e335-8bd3-4087-bec6-83980b6b45ac admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.754948 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.755871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.756246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.756572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.757285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.759406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.786366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1166/2333] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/users => generated 288 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:22.787738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.797328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.799569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcfe44-a4eb-45d7-8a2e-33ad7c00fad4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.804566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.805351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.805692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.806029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.806841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.808510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.824994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1168/2334] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:22.827288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.840939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a635ae7-cab0-45b6-b66e-95fd2cdaadf4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.846407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.847090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.847371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.847648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.848530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.850176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.868643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1169/2335] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:22.872787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:22.878146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2802d-9b3f-4783-b90c-552d0d392822 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.884163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.885098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.885253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2b8c4-50e3-47b5-8fa0-cc5ad134cb6a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:22.885806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.886111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.888429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.891834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:22.892797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.893125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.893399 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] PATH_INFO: `/v3/projects/fb9838b54a444d12a6bdc974231eb7d7/users/2dcc887872f94300853905dd7796a9da/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.910855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb9838b54a444d12a6bdc974231eb7d7, user_id=2dcc887872f94300853905dd7796a9da, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.913584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9253dc-3f2a-46bb-8c05-aeed4e871d88 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.928746 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1170/2336] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:22 2022] PUT /identity/v3/projects/fb9838b54a444d12a6bdc974231eb7d7/users/2dcc887872f94300853905dd7796a9da/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:22.939653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:22.939949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:22.940232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:22.972412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:22.972860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] MFA Rules not processed for user `2dcc887872f94300853905dd7796a9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:22.974116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:22.975270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:22.985816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1167/2337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:22 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:23.031310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:23.061458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1171/2338] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:23.066709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.082183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799ad2-a3b2-4d1e-b776-f561f5505d68 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.149611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:23.168701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.169480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.170251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.170251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.171131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.173874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.211280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1168/2339] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:23 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:23.213962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.227043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6aa6d7-9f94-4599-99fc-54d7fde5741f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.314113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.315053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.315332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.315608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.316326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.318715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.350366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1172/2340] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:23 2022] POST /identity/v3/users => generated 288 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:23.351829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.363912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db3455-30a3-4ae9-865b-ee49008df0e0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.369830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.370583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.370859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.371162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.371884 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.373558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.389786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1169/2341] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:23.391073 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.402802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156231c-a1d6-4a40-bf4b-bd39546cf4ad admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.407687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.408386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.408663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.408932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.409676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.411368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365acae1-ff45-4709-a377-1f2602fcc095 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.424573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1173/2342] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:23.430264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.454766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f5115-d4a9-4265-8a3e-24b982c8e59f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.461799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.463484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.464113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.464718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] PATH_INFO: `/v3/projects/5e268edf229a4f6281f935012c578624/users/f12f0d9eed24468c86a2e0b3c401d4d2/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.487661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e268edf229a4f6281f935012c578624, user_id=f12f0d9eed24468c86a2e0b3c401d4d2, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.493351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.519451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1170/2343] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:23 2022] PUT /identity/v3/projects/5e268edf229a4f6281f935012c578624/users/f12f0d9eed24468c86a2e0b3c401d4d2/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:23.532124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.532635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.533118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.594078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] MFA Rules not processed for user `f12f0d9eed24468c86a2e0b3c401d4d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:23.596105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:23.719811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1174/2344] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:23.725562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.805914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ed220-3478-44db-bf10-a539e867aebf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.811235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.811933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.812212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.812488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.813229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.815285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.848111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1171/2345] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:23 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:23.853130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:23.869259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e8cfe-216a-462c-b809-a94d80305526 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:23.940398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:23.959671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:23.960378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:23.960660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:23.960935 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:23.961650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:23.963671 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:23.986865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1175/2346] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:23 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:23.991585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:24.002792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a0589-48f7-4695-9cab-5d91e20d0f6e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:24.008148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:24.008871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.009150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.009420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.010208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:24.011879 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:24.034165 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1172/2347] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:24.037542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:24.055222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd608de-0eac-47cb-b3e3-663e7b300554 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:24.061142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:24.061812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.062123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.062429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] PATH_INFO: `/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c/users/9c401fc299524f4bb958555efa30d43c/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.083936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea08190cb5db4e4380bb5ee45efdcd4c, user_id=9c401fc299524f4bb958555efa30d43c, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:24.087472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:24.105578 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1176/2348] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:24 2022] PUT /identity/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c/users/9c401fc299524f4bb958555efa30d43c/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:24.110131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:24.124471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306aa6c-b339-4432-8239-08a020b2cabe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:24.231613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:24.232644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.233133 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.233650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.234986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:24.238082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f227e0-473b-4b3a-9427-dacab445e192 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:24.258157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1173/2349] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:24.263134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:24.277086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393b9c71-2491-4b51-9e09-b686661ca747 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:24.287976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:24.289004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.289408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.290986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] PATH_INFO: `/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c/users/9c401fc299524f4bb958555efa30d43c/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.293537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea08190cb5db4e4380bb5ee45efdcd4c, user_id=9c401fc299524f4bb958555efa30d43c, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:24.296980 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:24.310511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1177/2350] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:24 2022] PUT /identity/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c/users/9c401fc299524f4bb958555efa30d43c/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:24.324729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.325154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.325533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.350231 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:24.364490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] MFA Rules not processed for user `9c401fc299524f4bb958555efa30d43c`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:24.367525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:24.468546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1174/2351] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:24.481003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:24.483411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:24.558983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e117435-095b-4031-b0bd-1536820e3fae admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:24.563607 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:24.564284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:24.564555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:24.564823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:24.647284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:24.648818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:24.661636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1178/2352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:27.496570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:27.508043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58913bdb-eaf1-45d4-b9a6-10b5f7aa70e9 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:27.514406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:27.515173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:27.515483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:27.515831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:27.594109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:27.595748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:27.607685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1175/2353] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:29.666273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:29.675714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af83b68b-444c-4a6c-bec5-da27c28897b2 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:29.680498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:29.681151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:29.681476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:29.681779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:29.695242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:29.696845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e2887-6040-4612-a18d-8bfc1bd5db79 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:29.709402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1179/2354] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:35.186037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:35.188223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:35.280192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce0608-ce91-4670-ba0e-02100ba52fc3 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:35.288296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:35.289849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:35.290516 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:35.290835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] PATH_INFO: `/v3/users/56e33f05f5224e899cf97f1a89c18388` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:35.293135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] RBAC: Authorizing `identity:delete_user(user_id=56e33f05f5224e899cf97f1a89c18388)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:35.296894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:35.364458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:35.379427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56e33f05f5224e899cf97f1a89c18388'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:35.389138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56e33f05f5224e899cf97f1a89c18388'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:35.406155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56e33f05f5224e899cf97f1a89c18388'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:35.407818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56e33f05f5224e899cf97f1a89c18388'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:35.418221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56e33f05f5224e899cf97f1a89c18388'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:35.425074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1176/2355] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:35 2022] DELETE /identity/v3/users/56e33f05f5224e899cf97f1a89c18388 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:35.430463 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:35.431079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:35.431193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:35.452445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:35.455106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:35.531375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:35.561423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1180/2356] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:35.572063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:35.580269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:35.678753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c06eca-093d-413d-b071-01ee5526a43a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:35.683603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:35.684288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:35.684567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:35.684850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:35.698032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:35.700533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:35.720151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1177/2357] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:36.063791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:36.065372 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:36.083835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2b9d2-fda0-4afd-9eb5-69519ce6fb83 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:36.090398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:36.091545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:36.092023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:36.093382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] PATH_INFO: `/v3/projects/2a1b12b9245b45b491b801fbb4640052` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:36.094305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1b12b9245b45b491b801fbb4640052)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:36.098405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:36.167814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1b12b9245b45b491b801fbb4640052', 'request_id': 'req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.175070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1b12b9245b45b491b801fbb4640052', 'request_id': 'req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.185129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1b12b9245b45b491b801fbb4640052', 'request_id': 'req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.201294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] The token cache is being invalidate because project 2a1b12b9245b45b491b801fbb4640052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:36.201638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.202406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.204591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1181/2358] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:36 2022] DELETE /identity/v3/projects/2a1b12b9245b45b491b801fbb4640052 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:36.209223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:36.222399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be91f9-dddd-41ea-8d3e-efa10b8e68e1 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:36.307728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:36.308633 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:36.308913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:36.309586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] PATH_INFO: `/v3/users/9bf5c5f138034ef7b0f782821f76a2ed` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:36.310817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf5c5f138034ef7b0f782821f76a2ed)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:36.312993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:36.382283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf5c5f138034ef7b0f782821f76a2ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.392514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf5c5f138034ef7b0f782821f76a2ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.397274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:36.419103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf5c5f138034ef7b0f782821f76a2ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.420105 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf5c5f138034ef7b0f782821f76a2ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.434543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39607b0e-4ea6-4305-9f90-0716d8ccd394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf5c5f138034ef7b0f782821f76a2ed'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:36.446644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1178/2359] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:36 2022] DELETE /identity/v3/users/9bf5c5f138034ef7b0f782821f76a2ed => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:36.894246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:36.895811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:36.916564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2931-e094-4e8b-a33b-231d2acd3f3a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.002257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.003320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.003867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.004332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] PATH_INFO: `/v3/projects/33f9cee85907445682ec8b109c66b369` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.007138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f9cee85907445682ec8b109c66b369)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.012307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.095834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f9cee85907445682ec8b109c66b369', 'request_id': 'req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:37.103091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f9cee85907445682ec8b109c66b369', 'request_id': 'req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:37.112985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f9cee85907445682ec8b109c66b369', 'request_id': 'req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:37.128253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:37.133623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] The token cache is being invalidate because project 33f9cee85907445682ec8b109c66b369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:37.134281 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:37.135690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c0de3cb0-ba60-4baa-8604-be6f7aa2c069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:37.138268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1182/2360] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:36 2022] DELETE /identity/v3/projects/33f9cee85907445682ec8b109c66b369 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:37.143558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.144371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.144371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.168438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:37.169748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:37.294681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1179/2361] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:37.307643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.308146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.308640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.334498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:37.335765 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:37.344576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1183/2362] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:37.348827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.360127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85a93e-6a88-4d84-b88c-8aa996733d32 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.366035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.366912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.367123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.367644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.368638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:37.368925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.371020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.388642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1180/2363] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:38:37.395839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.410336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7d598-28de-4830-a6dd-104425a9c6e7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.417439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.418889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.419467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.419930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.421303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.425257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.465036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1184/2364] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:37.468765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.484926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f305e9-16f2-49c3-b020-31963a9e34af admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.634641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.635833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.636324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.636807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.638220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.642219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.678730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1181/2365] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:37.685780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.698998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724a263-e42a-4f6e-9116-a44f8dee2f3b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.705456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.706492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.706640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.706845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.707605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.709406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.724820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1185/2366] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:37.729529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.740914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069a1bb-b7fe-4aa1-8676-34520e5e5709 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.746587 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.747317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.747617 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.747915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.748699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.750490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb451bba-a62a-4638-803e-85d7caddaeef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.764290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1182/2367] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:37.769276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:37.785897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344ffa8-2908-4c9f-a889-c5e4cd6f12e8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:37.794169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:37.795807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.796300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.796629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] PATH_INFO: `/v3/projects/d24d879e2e014d4eab98e598fc5aa0e1/users/c7ea600cb3b94d1fa98567fd2d911973/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.815628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24d879e2e014d4eab98e598fc5aa0e1, user_id=c7ea600cb3b94d1fa98567fd2d911973, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:37.818631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:37.836920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1186/2368] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:37 2022] PUT /identity/v3/projects/d24d879e2e014d4eab98e598fc5aa0e1/users/c7ea600cb3b94d1fa98567fd2d911973/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:37.849594 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:37.849865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:37.850176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:37.885584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] MFA Rules not processed for user `c7ea600cb3b94d1fa98567fd2d911973`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:37.887202 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:37.931173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:37.978007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1183/2369] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:37.982777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.073604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e5b045-9b24-4c67-8fe8-e94b1d87f5f0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.079326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.080156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.080457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.080748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.081500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.083596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.121402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1187/2370] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:37 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:38:38.126188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.144203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695079c4-e053-4c9c-a55e-f744092f0902 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.211009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.212076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.212394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.212666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.213372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.215361 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.240469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1184/2371] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:38 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:38.246991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.263118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c127f2-3638-413a-abc1-01805ed096ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.267943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.268657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.268938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.269214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.269962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.271626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.288713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1188/2372] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:38.295214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.311876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a3e01-3a17-4ea6-8c07-bb6840af0058 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.319743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.323138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.323431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.323732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] PATH_INFO: `/v3/projects/3d3c3f0ba7d744e58f09a0db03508121/users/f44fc7da5c57467ebb47aefaf33f63fa/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.356667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3c3f0ba7d744e58f09a0db03508121, user_id=f44fc7da5c57467ebb47aefaf33f63fa, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.359920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.392699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1185/2373] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:38 2022] PUT /identity/v3/projects/3d3c3f0ba7d744e58f09a0db03508121/users/f44fc7da5c57467ebb47aefaf33f63fa/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:38.396770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.409233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2baf-43a3-42b6-a726-d471b23c3161 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.411292 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.413899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:38.487157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb06b3d6-1c8e-4c77-a053-c7df6b663573 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.491338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.491947 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.492480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.492668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.493011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.493666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.493960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.494158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.494305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] PATH_INFO: `/v3/users/2dcc887872f94300853905dd7796a9da` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.495769 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcc887872f94300853905dd7796a9da)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.496012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.497964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.512143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1189/2374] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:38.513424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.523914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1c5d59-a12c-4732-8211-4eaf63943c19 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.529597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.530550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.530829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.531099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] PATH_INFO: `/v3/projects/3d3c3f0ba7d744e58f09a0db03508121/users/f44fc7da5c57467ebb47aefaf33f63fa/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.533336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3c3f0ba7d744e58f09a0db03508121, user_id=f44fc7da5c57467ebb47aefaf33f63fa, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.536713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399ecabe-2b2f-4660-9628-215430a2cc50 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.539326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:38.544414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:38.551120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1190/2375] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:38 2022] PUT /identity/v3/projects/3d3c3f0ba7d744e58f09a0db03508121/users/f44fc7da5c57467ebb47aefaf33f63fa/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:38.558641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcc887872f94300853905dd7796a9da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:38.562156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.562441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.562726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.569331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcc887872f94300853905dd7796a9da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:38.583378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcc887872f94300853905dd7796a9da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:38.584359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcc887872f94300853905dd7796a9da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:38.592683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-8eb7379b-7b51-428d-a09c-42f0ed78868a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcc887872f94300853905dd7796a9da'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:38.599281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1186/2376] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:38 2022] DELETE /identity/v3/users/2dcc887872f94300853905dd7796a9da => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:38.604297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.604580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.604854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.612594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] MFA Rules not processed for user `f44fc7da5c57467ebb47aefaf33f63fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:38.614835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:38.623894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:38.625453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:38.716458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1191/2377] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:38.727628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.729065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:38.733107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1187/2378] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:38.743570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:38.744913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:38.818369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df8c79-1eff-4e8d-8a5f-e0d6f430d10f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.822014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa4942-7be7-4465-ad71-982aec6e0f15 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:38.825840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.826886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.827353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.827627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.832437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:38.833666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:38.834499 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:38.835048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:38.839261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.840788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.853026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1188/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:38.856310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:38.859302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:38.878846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1192/2380] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:38:39.349130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:39.350885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:39.366743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018a46-9587-418b-a0b5-4da29ab930e6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:39.372642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:39.373533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:39.373811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:39.374121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] PATH_INFO: `/v3/projects/fb9838b54a444d12a6bdc974231eb7d7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:39.375406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb9838b54a444d12a6bdc974231eb7d7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:39.377374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:39.435094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb9838b54a444d12a6bdc974231eb7d7', 'request_id': 'req-12ca20c7-8e21-41dc-a930-116b3f3e7b38'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.438333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:39.444476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb9838b54a444d12a6bdc974231eb7d7', 'request_id': 'req-12ca20c7-8e21-41dc-a930-116b3f3e7b38'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.460815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb9838b54a444d12a6bdc974231eb7d7', 'request_id': 'req-12ca20c7-8e21-41dc-a930-116b3f3e7b38'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.478094 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] The token cache is being invalidate because project fb9838b54a444d12a6bdc974231eb7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:39.478555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.479154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.480795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1189/2381] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:39 2022] DELETE /identity/v3/projects/fb9838b54a444d12a6bdc974231eb7d7 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:39.485509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:39.498165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755931-b8e5-4647-9ccb-9c3a8048ef4d service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:39.569901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:39.571104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:39.571382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:39.571802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] PATH_INFO: `/v3/users/f12f0d9eed24468c86a2e0b3c401d4d2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:39.573041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f12f0d9eed24468c86a2e0b3c401d4d2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:39.575161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:39.603091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=1,keystone:SELECT=95,keystone:DELETE=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:39.611406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:39.613128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:39.627145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca20c7-8e21-41dc-a930-116b3f3e7b38 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:39.631846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:39.632774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:39.633108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:39.633500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f12f0d9eed24468c86a2e0b3c401d4d2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.634099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] PATH_INFO: `/v3/users/c7ea600cb3b94d1fa98567fd2d911973` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:39.635382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ea600cb3b94d1fa98567fd2d911973)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:39.637336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:39.641333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f12f0d9eed24468c86a2e0b3c401d4d2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.642236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f12f0d9eed24468c86a2e0b3c401d4d2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.652342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f12f0d9eed24468c86a2e0b3c401d4d2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.653083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1b6c9540-ca6c-46bf-8f56-bf32546df3c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f12f0d9eed24468c86a2e0b3c401d4d2'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.678428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1193/2382] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:39 2022] DELETE /identity/v3/users/f12f0d9eed24468c86a2e0b3c401d4d2 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:39.704644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ea600cb3b94d1fa98567fd2d911973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.731376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ea600cb3b94d1fa98567fd2d911973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.744644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ea600cb3b94d1fa98567fd2d911973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.745555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ea600cb3b94d1fa98567fd2d911973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.758276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ea600cb3b94d1fa98567fd2d911973'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:39.769293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1190/2383] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:39 2022] DELETE /identity/v3/users/c7ea600cb3b94d1fa98567fd2d911973 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:39.773852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:39.774044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:39.774388 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:39.796083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:39.797335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:39.864796 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1194/2384] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:39.875332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:39.878027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:39.975482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3aee13-ab9e-4861-8ea9-2d87e658604a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:39.980321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:39.981047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:39.981462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:39.981721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:39.992839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:39.994665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:40.005692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1191/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:40.481645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:40.483451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:40.497267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c69b1-dec1-46a0-a638-f693f6a69c33 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:40.503511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:40.504589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:40.505097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:40.505448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] PATH_INFO: `/v3/projects/d24d879e2e014d4eab98e598fc5aa0e1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:40.509236 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24d879e2e014d4eab98e598fc5aa0e1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:40.511745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:40.578707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24d879e2e014d4eab98e598fc5aa0e1', 'request_id': 'req-a9008d95-a8ce-4d8e-8b5a-404849049d39'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.586494 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24d879e2e014d4eab98e598fc5aa0e1', 'request_id': 'req-a9008d95-a8ce-4d8e-8b5a-404849049d39'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.596730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24d879e2e014d4eab98e598fc5aa0e1', 'request_id': 'req-a9008d95-a8ce-4d8e-8b5a-404849049d39'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.631219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] The token cache is being invalidate because project d24d879e2e014d4eab98e598fc5aa0e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:40.631714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.633139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.636673 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1195/2386] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:40 2022] DELETE /identity/v3/projects/d24d879e2e014d4eab98e598fc5aa0e1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:40.642019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:40.660066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba6e3b-b35a-4fd9-a9f0-da2d67f827ad service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:40.741620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:40.744453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:40.745413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:40.756359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:40.757953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:40.758620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:40.759544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] PATH_INFO: `/v3/users/f44fc7da5c57467ebb47aefaf33f63fa` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:40.762220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f44fc7da5c57467ebb47aefaf33f63fa)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:40.766040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:40.770255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9008d95-a8ce-4d8e-8b5a-404849049d39 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:40.777422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:40.778475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:40.778819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:40.779157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] PATH_INFO: `/v3/projects/5e268edf229a4f6281f935012c578624` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:40.780528 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e268edf229a4f6281f935012c578624)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:40.782629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:40.812547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:40.854973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f44fc7da5c57467ebb47aefaf33f63fa'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.863052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e268edf229a4f6281f935012c578624', 'request_id': 'req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.868508 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f44fc7da5c57467ebb47aefaf33f63fa'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.878287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e268edf229a4f6281f935012c578624', 'request_id': 'req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.888932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e268edf229a4f6281f935012c578624', 'request_id': 'req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.898319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f44fc7da5c57467ebb47aefaf33f63fa'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.899784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f44fc7da5c57467ebb47aefaf33f63fa'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.909086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] The token cache is being invalidate because project 5e268edf229a4f6281f935012c578624 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:40.909686 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.911573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f44fc7da5c57467ebb47aefaf33f63fa'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.911790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:40.915094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1196/2387] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:40 2022] DELETE /identity/v3/projects/5e268edf229a4f6281f935012c578624 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:40.918765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1192/2388] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:40 2022] DELETE /identity/v3/users/f44fc7da5c57467ebb47aefaf33f63fa => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:40.920381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:40.922960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:41.058180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673a8b-4d08-4b7d-9a8d-45b487ca1c49 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:41.185071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:41.186251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.186530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.186806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] PATH_INFO: `/v3/users/9c401fc299524f4bb958555efa30d43c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.188101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c401fc299524f4bb958555efa30d43c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:41.190147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:41.248428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c401fc299524f4bb958555efa30d43c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.259125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c401fc299524f4bb958555efa30d43c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.259978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c401fc299524f4bb958555efa30d43c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.263763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:41.271876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c401fc299524f4bb958555efa30d43c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.272225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-0190ab39-a61a-4c8a-b6f5-d56e10ffe183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c401fc299524f4bb958555efa30d43c'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.295316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1197/2389] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:38:40 2022] DELETE /identity/v3/users/9c401fc299524f4bb958555efa30d43c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:41.314729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:41.316222 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:41.338327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19cfa2-c02b-49a0-8d4e-b42f3e7b36a6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:41.420028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:41.421547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.421829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.422139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] PATH_INFO: `/v3/projects/3d3c3f0ba7d744e58f09a0db03508121` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.423998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3c3f0ba7d744e58f09a0db03508121)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:41.427584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:41.505015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3c3f0ba7d744e58f09a0db03508121', 'request_id': 'req-9d469899-91a8-4279-ada4-a357c4faf1a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.516786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3c3f0ba7d744e58f09a0db03508121', 'request_id': 'req-9d469899-91a8-4279-ada4-a357c4faf1a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.524866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3c3f0ba7d744e58f09a0db03508121', 'request_id': 'req-9d469899-91a8-4279-ada4-a357c4faf1a9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.538777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] The token cache is being invalidate because project 3d3c3f0ba7d744e58f09a0db03508121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:41.539175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.540185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.542846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1193/2390] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:41 2022] DELETE /identity/v3/projects/3d3c3f0ba7d744e58f09a0db03508121 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:38:41.547927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3afc-ad99-4df8-a83d-1c2c24e2173d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.548462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3afc-ad99-4df8-a83d-1c2c24e2173d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.548729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3afc-ad99-4df8-a83d-1c2c24e2173d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.578991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ec4a3afc-ad99-4df8-a83d-1c2c24e2173d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:41.580350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ec4a3afc-ad99-4df8-a83d-1c2c24e2173d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:41.645247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:41.646885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:41.669653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:41.673523 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1198/2391] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:41.691275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.691548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.691833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.715708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:41.716949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:41.729386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1199/2392] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:41.734854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:41.750290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010d62b-5a51-4ccd-912d-b24c7ecb3cac None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:41.759632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:41.760776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.761439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.761919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.763357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:41.763925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:41.766939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:41.784661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d469899-91a8-4279-ada4-a357c4faf1a9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:41.795482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:41.797034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.797488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.797937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] PATH_INFO: `/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.802683 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1200/2393] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:41.802961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea08190cb5db4e4380bb5ee45efdcd4c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:41.803613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:41.816865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:41.864634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92418850-3a62-4585-99bd-6badec5057bf admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:41.891227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:41.892065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.892450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.892827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.893663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:41.897464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:41.921564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea08190cb5db4e4380bb5ee45efdcd4c', 'request_id': 'req-c39d3684-73d0-4cf7-ad02-d26f0a58e464'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.936972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea08190cb5db4e4380bb5ee45efdcd4c', 'request_id': 'req-c39d3684-73d0-4cf7-ad02-d26f0a58e464'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.949755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea08190cb5db4e4380bb5ee45efdcd4c', 'request_id': 'req-c39d3684-73d0-4cf7-ad02-d26f0a58e464'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.974104 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] The token cache is being invalidate because project ea08190cb5db4e4380bb5ee45efdcd4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:38:41.974398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.975301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c39d3684-73d0-4cf7-ad02-d26f0a58e464 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:38:41.977736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1194/2394] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:38:41 2022] DELETE /identity/v3/projects/ea08190cb5db4e4380bb5ee45efdcd4c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:41.986256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c1bc-d695-4660-b6f4-19bcd4834edb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:41.987259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c1bc-d695-4660-b6f4-19bcd4834edb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:41.988268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1201/2395] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:41 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:41.989127 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402c1bc-d695-4660-b6f4-19bcd4834edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:41.993089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:41.995064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.040263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3402c1bc-d695-4660-b6f4-19bcd4834edb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:42.042933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3402c1bc-d695-4660-b6f4-19bcd4834edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.098930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372a855d-3c3f-42e6-ab7a-aef2157d90f6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.104411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386d89-3935-431c-998d-176022058bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.105103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386d89-3935-431c-998d-176022058bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.105382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386d89-3935-431c-998d-176022058bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.105838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386d89-3935-431c-998d-176022058bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.106404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11386d89-3935-431c-998d-176022058bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.108519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11386d89-3935-431c-998d-176022058bdd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.135005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1202/2396] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:41 2022] POST /identity/v3/users => generated 292 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:42.140390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386d89-3935-431c-998d-176022058bdd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.153138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386d89-3935-431c-998d-176022058bdd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.160285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.160649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.160867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.161300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.162178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.164075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.177339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1203/2397] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:42.178275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1195/2398] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:42.183448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.189358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.189768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.190426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.196986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b7300c-6787-43f2-bf6b-12106843b1bc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.211071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.211071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.211071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.211071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.211711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.211711 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.216812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:42.220073 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:42.222152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.229674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1204/2399] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:38:42.239621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.239870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1196/2400] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:38:42.241521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.252342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad46f34-95f0-4899-87b9-813b0079805e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.262921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c14126-8794-4aa2-b892-814c270c1632 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.270028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.271106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.271467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.271807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] PATH_INFO: `/v3/projects/6000e40c544b44ce9fe06dee2581501c/users/4187a86f8be1403bb67c05d461f73f5b/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.273820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.275727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.277501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.278002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.279294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:38:42.280008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.282533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.291012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=6000e40c544b44ce9fe06dee2581501c, user_id=4187a86f8be1403bb67c05d461f73f5b, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.294636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e030c5-c96a-494f-bb23-7dc8f27139ad admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.300911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1197/2401] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:38:42.307113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.313333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1205/2402] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:42 2022] PUT /identity/v3/projects/6000e40c544b44ce9fe06dee2581501c/users/4187a86f8be1403bb67c05d461f73f5b/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:42.321727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d762bb7c-9fc9-41e2-926a-f797e503649d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.325277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.325559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.325835 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.339267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:42.368549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] MFA Rules not processed for user `4187a86f8be1403bb67c05d461f73f5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:42.371175 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.399850 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.400436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.400945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.401243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.401947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.403998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.445270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1198/2403] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:38:42 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:42.450569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.487918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1206/2404] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:42.501555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.503263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.557699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be0e2a-f8a3-4d6f-8bea-cbc748dc038a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.562664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.563364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.563642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.563920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.564631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.566662 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.586722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb5890-caa9-4aa5-af71-d1be9b928fbb None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.599484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1199/2405] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:38:42 2022] POST /identity/v3/users => generated 295 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:38:42.604443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.616456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd503cd6-c843-4470-9145-3f118ac66c29 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.621704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.622437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.622710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.622981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.623735 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.625421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.637112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1200/2406] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:42.641717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.653483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc1986a-0cfa-467b-9e15-dd084c44841f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.658822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.659507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.659789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.660066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.660810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.661095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.661781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.662046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.662351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.662482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.674442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1201/2407] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:38:42.678810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.689051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8710-ff7d-4bd2-9fe3-9368f16176de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:42.693886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:42.694821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.695107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.695450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] PATH_INFO: `/v3/projects/a2580d9580df42808570653ef93eb14e/users/46c6655c3e8e479f96fa82719ddac4f9/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.699874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:42.720011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2580d9580df42808570653ef93eb14e, user_id=46c6655c3e8e479f96fa82719ddac4f9, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.724283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7639e5-0d97-4083-b620-ea0e3451d4c2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.743168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1202/2408] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:38:42 2022] PUT /identity/v3/projects/a2580d9580df42808570653ef93eb14e/users/46c6655c3e8e479f96fa82719ddac4f9/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:38:42.753787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:42.755602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:42.756076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:42.756887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:42.757396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:42.767233 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1207/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:42.807280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] MFA Rules not processed for user `46c6655c3e8e479f96fa82719ddac4f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:38:42.809398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:42.871882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:38:42.942282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1203/2410] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:38:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:38:42.961292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:42.964247 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:43.008422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67703669-bb47-475f-8245-66ecd0b41de6 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:43.151710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:43.152884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:43.153428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:43.153942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:43.169531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:43.172022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3bc66d-32f4-43ca-a4b5-e8143dafb3df service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:43.193729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1208/2411] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:51.372698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:38:51.374591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:51.489263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7c415-9913-41d9-bdda-82f6d5245f26 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:38:51.495261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:38:51.495918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:38:51.496203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:38:51.496480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:38:51.498713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:38:51.514366 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:38:51.516268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:38:51.528583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1204/2412] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:38:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:38:53.185295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=37 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:01.204065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc898-1ed6-4ee0-ae0b-b1ca3246ec9e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:01.204774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc898-1ed6-4ee0-ae0b-b1ca3246ec9e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:01.204774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc898-1ed6-4ee0-ae0b-b1ca3246ec9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:01.225170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1d4bc898-1ed6-4ee0-ae0b-b1ca3246ec9e None None] MFA Rules not processed for user `9bbb5d4487874bdd9f82e28651a418f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:01.226495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1d4bc898-1ed6-4ee0-ae0b-b1ca3246ec9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:01.299317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1209/2413] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:01.523030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=53 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:05.375920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:05.455153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e970a5-4662-4bfe-8d60-11f4db2909f3 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:05.463961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:05.463961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:05.464308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:05.464520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] PATH_INFO: `/v3/users/4187a86f8be1403bb67c05d461f73f5b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:05.465896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4187a86f8be1403bb67c05d461f73f5b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:05.468159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:05.535192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4187a86f8be1403bb67c05d461f73f5b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:05.546947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4187a86f8be1403bb67c05d461f73f5b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:05.562197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4187a86f8be1403bb67c05d461f73f5b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:05.562991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4187a86f8be1403bb67c05d461f73f5b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:05.570599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4187a86f8be1403bb67c05d461f73f5b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:05.580682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1205/2414] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:39:05 2022] DELETE /identity/v3/users/4187a86f8be1403bb67c05d461f73f5b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:05.583272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:05.584033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:05.584033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:05.606171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:05.607552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:05.687205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1210/2415] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:05.697317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:05.699009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:05.777163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370cbef1-0260-4694-b11b-510455dbc513 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:05.783492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:05.784579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:05.784865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:05.785115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:05.798797 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:05.801033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00534bea-cbf7-464d-b52b-5537bc79e1ee service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:05.816456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1206/2416] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:06.172674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.174278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:06.193457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b73a27c-5411-4263-be01-58ed9df2d2a0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.200766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.201210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.201497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.201774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] PATH_INFO: `/v3/projects/6000e40c544b44ce9fe06dee2581501c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.203589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6000e40c544b44ce9fe06dee2581501c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.206045 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.277794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6000e40c544b44ce9fe06dee2581501c', 'request_id': 'req-b2692a93-6c95-4c0d-9a0b-9080663108dd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:06.290856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6000e40c544b44ce9fe06dee2581501c', 'request_id': 'req-b2692a93-6c95-4c0d-9a0b-9080663108dd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:06.305511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6000e40c544b44ce9fe06dee2581501c', 'request_id': 'req-b2692a93-6c95-4c0d-9a0b-9080663108dd'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:06.324991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] The token cache is being invalidate because project 6000e40c544b44ce9fe06dee2581501c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:39:06.325381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:06.326248 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b2692a93-6c95-4c0d-9a0b-9080663108dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:06.333382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1211/2417] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:39:06 2022] DELETE /identity/v3/projects/6000e40c544b44ce9fe06dee2581501c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:06.336418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417abb-5342-432d-bc80-466f736711f0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.337385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417abb-5342-432d-bc80-466f736711f0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.337934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60417abb-5342-432d-bc80-466f736711f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.374619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-60417abb-5342-432d-bc80-466f736711f0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:06.376578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-60417abb-5342-432d-bc80-466f736711f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:06.418580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:06.493052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1207/2418] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:06.507874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.508279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.508562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.542205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:06.544220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:06.560577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1212/2419] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:06.566837 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417abb-5342-432d-bc80-466f736711f0 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.582693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60417abb-5342-432d-bc80-466f736711f0 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.588279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.588975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.589258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.589525 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.590304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:39:06.590609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.592308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.606816 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1208/2420] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:39:06.611438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.623540 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1c6b5-12bb-40ad-9c36-cbfbc5d1a702 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.628615 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.629944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.630414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.630826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.632048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.634719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.659936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:06.669351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1213/2421] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:39:06 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:06.681109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.692262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363d57d-e91f-4e75-9e11-79984cebd91e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.770616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.771309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.771592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.771875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.772593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.774815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.806554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1209/2422] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:39:06 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:06.811555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.824654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d43e72-c7dc-4502-839a-89eb535f25ef admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.830430 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.831122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.831407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.831690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.832437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.834152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.847527 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1214/2423] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:06.852642 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.865419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d985ced3-409e-477d-bf74-eaf5e2da6826 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.871181 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.871882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.872168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.872471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.873219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.874941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cda638-9971-40d3-aa06-98e9181e690a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.886831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1210/2424] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:06.891391 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:06.902611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ce23d1-5b91-48ad-b9b1-741e0b41b319 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:06.913879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:06.914844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.915195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.915480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] PATH_INFO: `/v3/projects/46a20699c2064864a4895f4a6cb327b4/users/80b9878f172f4c058a13df56b3852d1d/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.932408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a20699c2064864a4895f4a6cb327b4, user_id=80b9878f172f4c058a13df56b3852d1d, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:06.935320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:06.951271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1215/2425] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:06 2022] PUT /identity/v3/projects/46a20699c2064864a4895f4a6cb327b4/users/80b9878f172f4c058a13df56b3852d1d/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:06.963611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:06.963899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:06.964211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:06.995109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] MFA Rules not processed for user `80b9878f172f4c058a13df56b3852d1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:06.996330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:07.070755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1211/2426] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:07.082897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:07.084927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:07.170789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f4bfd-9264-4c89-a9c9-859127a760c9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:07.174921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:07.175579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:07.175861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:07.176134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:07.186358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:07.187915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2519c7d-1f8b-4546-9d19-876afecaf944 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:07.198903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1216/2427] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:13.199630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:13.222783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:13.272125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d127e2-9c4a-4e68-95b9-a6bb7e97f549 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:13.277560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:13.278761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:13.279039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:13.279309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] PATH_INFO: `/v3/users/80b9878f172f4c058a13df56b3852d1d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:13.280597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80b9878f172f4c058a13df56b3852d1d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:13.282687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:13.333150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80b9878f172f4c058a13df56b3852d1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:13.341240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80b9878f172f4c058a13df56b3852d1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:13.354609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80b9878f172f4c058a13df56b3852d1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:13.355944 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80b9878f172f4c058a13df56b3852d1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:13.363233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80b9878f172f4c058a13df56b3852d1d'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:13.370407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1212/2428] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:39:13 2022] DELETE /identity/v3/users/80b9878f172f4c058a13df56b3852d1d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:13.375564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:13.376033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:13.376143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:13.394885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:13.396122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:13.457257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1217/2429] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:13.467761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:13.469449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:13.536897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3164e8f-9a03-4f43-8408-c0dbf7d3e14a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:13.541653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:13.542838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:13.542838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:13.543091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:13.553874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:13.555369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9ee95-b25a-473d-aed3-144eb7ea9612 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:13.565448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1213/2430] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:13.918566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:13.921051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:13.942300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e9daa-683c-4a79-bda3-0636a1f4a2e6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:13.949193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:13.950871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:13.951518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:13.951964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] PATH_INFO: `/v3/projects/46a20699c2064864a4895f4a6cb327b4` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:13.954651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a20699c2064864a4895f4a6cb327b4)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:13.958921 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:14.054977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a20699c2064864a4895f4a6cb327b4', 'request_id': 'req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:14.064720 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a20699c2064864a4895f4a6cb327b4', 'request_id': 'req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:14.075833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a20699c2064864a4895f4a6cb327b4', 'request_id': 'req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:14.078887 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:14.093846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] The token cache is being invalidate because project 46a20699c2064864a4895f4a6cb327b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:39:14.094179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:14.094863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:14.096491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1218/2431] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:39:13 2022] DELETE /identity/v3/projects/46a20699c2064864a4895f4a6cb327b4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:21.685350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:21.686030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:21.686030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:21.756036 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:21.760761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:21.763289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:21.870211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1214/2432] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:39:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:39:21.922347 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:21.924334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:22.050363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5375d9-23a6-4c05-a6d6-62f95cf27f61 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:22.056127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:22.056817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:22.057099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:22.057377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:22.069138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:22.072326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb217d3-5c2d-461f-99e2-7b4236cecae8 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:22.091176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1219/2433] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:39:22.304941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:22.307855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:22.439889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f121d8e-33e6-4ace-9714-d794a327e33c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:22.446862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:22.449706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:22.449706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:22.449706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] PATH_INFO: `/v3/users/46c6655c3e8e479f96fa82719ddac4f9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:22.451375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46c6655c3e8e479f96fa82719ddac4f9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:22.454707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:22.555936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46c6655c3e8e479f96fa82719ddac4f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:22.566074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46c6655c3e8e479f96fa82719ddac4f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:22.599455 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46c6655c3e8e479f96fa82719ddac4f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:22.600401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46c6655c3e8e479f96fa82719ddac4f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:22.611941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46c6655c3e8e479f96fa82719ddac4f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:22.626513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1215/2434] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:39:22 2022] DELETE /identity/v3/users/46c6655c3e8e479f96fa82719ddac4f9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:39:22.629783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:22.630285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:22.631404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:22.673724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:22.675179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:22.788783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1220/2435] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:39:22.801468 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:22.805624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:22.854700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:22.938862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e2bd8-32d4-4b1c-b8be-7695368bdaa3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:22.944300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:22.945276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:22.945606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:22.945961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:22.958422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:22.960039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a131d1-8946-48e2-88f8-8d2534058626 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:22.986534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1216/2436] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:23.427296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:23.431621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:23.463879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1255806-2e28-43fc-9a14-df45a8b8daaa None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:23.486331 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:23.487660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:23.488164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:23.488619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] PATH_INFO: `/v3/projects/a2580d9580df42808570653ef93eb14e` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:23.501163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2580d9580df42808570653ef93eb14e)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:23.505182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:23.645566 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2580d9580df42808570653ef93eb14e', 'request_id': 'req-13695765-a710-4a87-8a08-54a81e92e102'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:23.667519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=1,keystone:DELETE=7,keystone:SELECT=92 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:23.670340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2580d9580df42808570653ef93eb14e', 'request_id': 'req-13695765-a710-4a87-8a08-54a81e92e102'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:23.690119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2580d9580df42808570653ef93eb14e', 'request_id': 'req-13695765-a710-4a87-8a08-54a81e92e102'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:23.780614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] The token cache is being invalidate because project a2580d9580df42808570653ef93eb14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:39:23.781546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:23.783817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-13695765-a710-4a87-8a08-54a81e92e102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:23.786221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1221/2437] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:39:23 2022] DELETE /identity/v3/projects/a2580d9580df42808570653ef93eb14e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:23.794171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:23.794171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:23.794171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:23.863883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:23.867978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:24.005810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1217/2438] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:24.017590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.017913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.018257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.069056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:24.071385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:24.087655 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1222/2439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:39:24.094562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.143439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09666412-d4a3-4554-8025-c4b6066c7cb7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.164779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.166940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.171343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.172168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.173909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:39:24.176729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.179115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.212684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1218/2440] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:39:24.220509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.236542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74abe7e2-9393-4df3-b441-ec96006d8f3c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.242861 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.243636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.243986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.244334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.245063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.247310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.313554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1223/2441] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:39:24 2022] POST /identity/v3/projects => generated 371 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:24.315337 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.334330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f65cb-01ba-4d2e-812b-4920c41d68b2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.471565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.475219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.475656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.476176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.477416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.488476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.524493 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1219/2442] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:39:24 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:39:24.616879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.635165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32593ebb-3706-4890-89e8-a1a8c891218f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.642763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.644017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.644585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.645117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.646603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.649353 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.679548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.688315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1224/2443] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:24.703037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb50fb4-200d-4e23-93e3-1ed1663d4358 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.711311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.712386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.712845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.713305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.715142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.718467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ed5ec-e0cf-421a-9516-10397e427758 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.759248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1220/2444] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:39:24.761562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:24.791462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e566a0f-1cb3-4fa0-9102-97190d0d0f55 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:24.823002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:24.824658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.825145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.827013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] PATH_INFO: `/v3/projects/f07dc511991f4d9f87aa5256f76e402c/users/c0579a5ba91a4aa89b676598b6d9dfeb/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.894456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f07dc511991f4d9f87aa5256f76e402c, user_id=c0579a5ba91a4aa89b676598b6d9dfeb, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:24.903320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:24.957675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1225/2445] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:24 2022] PUT /identity/v3/projects/f07dc511991f4d9f87aa5256f76e402c/users/c0579a5ba91a4aa89b676598b6d9dfeb/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:39:24.972184 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ee6f-1e59-4f32-b444-ef87c1a621a1 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:24.972833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ee6f-1e59-4f32-b444-ef87c1a621a1 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:24.973005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ee6f-1e59-4f32-b444-ef87c1a621a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:24.999656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fed9ee6f-1e59-4f32-b444-ef87c1a621a1 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:25.002817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fed9ee6f-1e59-4f32-b444-ef87c1a621a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:25.040606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:25.225420 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1221/2446] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:25.241001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:25.242917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:25.336474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815ac1-74d3-494a-a753-54e1483db4fb admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:25.342514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:25.343204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:25.343489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:25.343771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:25.367654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:25.370403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:25.406267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1226/2447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:32.473551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:32.474298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:32.474298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:32.514121 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] MFA Rules not processed for user `c0579a5ba91a4aa89b676598b6d9dfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:32.516655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:32.615607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1222/2448] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:32.619847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:32.638834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c59b53-eded-42ad-9db8-e57a58b73de3 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:32.648504 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:32.649489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:32.649806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:32.650305 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:32.651234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:32.653956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:32.707998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1227/2449] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:39:32 2022] POST /identity/v3/projects => generated 373 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:32.708997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:32.734414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43972a3-db85-46b5-83f3-7aacf4fb2ad3 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:32.839849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:32.840665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:32.841168 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:32.841737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:32.842635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:32.845187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:32.876700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1223/2450] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:39:32 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:39:32.902863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:32.979448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862858e-d122-4384-abd9-0ea26c19afd6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:32.993475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:32.996552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:32.996552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:32.997153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:33.000039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:33.018458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:33.070340 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1228/2451] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:33.073331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:33.090417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa7eb5-a2af-4797-9c60-9b9d805cd6e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:33.107025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:33.108332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:33.109022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:33.109482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] PATH_INFO: `/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64/users/5a2f77cdf786411faad0acd1da264c2b/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:33.144561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbed8eff2e94258a13b7c6022c3ec64, user_id=5a2f77cdf786411faad0acd1da264c2b, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:33.153660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:33.193754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1224/2452] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:33 2022] PUT /identity/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64/users/5a2f77cdf786411faad0acd1da264c2b/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:33.194704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:33.213225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc68-7c4f-4beb-af61-ece483d44d46 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:33.374802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:33.407642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:33.408716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:33.410767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:33.411458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:33.415108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:33.420731 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:33.470203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1229/2453] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:33.479505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:33.498004 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41346d-7476-4c45-9135-f3b5b796ce05 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:33.514212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:33.515492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:33.517991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:33.518486 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] PATH_INFO: `/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64/users/5a2f77cdf786411faad0acd1da264c2b/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:33.529274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fbed8eff2e94258a13b7c6022c3ec64, user_id=5a2f77cdf786411faad0acd1da264c2b, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:33.533254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68186096-e16c-48ad-a9eb-ff61ff23efe8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:33.551031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1225/2454] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:33 2022] PUT /identity/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64/users/5a2f77cdf786411faad0acd1da264c2b/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:40.710202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:40.712561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:40.790363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6240a-056c-4b64-9bde-a60d5e2a2283 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:40.942300 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:40.943244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:40.943537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:40.943819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] PATH_INFO: `/v3/users/93c4ce6932c84fc7acadd6583dd895c7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:40.945135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c4ce6932c84fc7acadd6583dd895c7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:40.947214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:41.090575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c4ce6932c84fc7acadd6583dd895c7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:41.105158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c4ce6932c84fc7acadd6583dd895c7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:41.105961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c4ce6932c84fc7acadd6583dd895c7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:41.125393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c4ce6932c84fc7acadd6583dd895c7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:41.126134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c4ce6932c84fc7acadd6583dd895c7'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:41.163120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1230/2455] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:39:40 2022] DELETE /identity/v3/users/93c4ce6932c84fc7acadd6583dd895c7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:41.167930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:41.168891 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:41.169334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:41.191956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:41.204945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:41.208954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:41.372182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1226/2456] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:41.439539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:41.441122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:41.595083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89653a2-c8c9-4cdf-8893-a4d2a393a246 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:41.608006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:41.608941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:41.609277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:41.609589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:41.626931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:41.628730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca1aa7d-ef72-4c19-8c57-63145413a350 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:41.641371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1231/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:42.432721 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:42.434822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:42.454333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3364870-dfde-46fc-b43f-ef9119aca16c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:42.474353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:42.475288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:42.476194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:42.476663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] PATH_INFO: `/v3/projects/e869eda0b6354565b8854d48032f318e` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:42.479932 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e869eda0b6354565b8854d48032f318e)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:42.482407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:42.631658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e869eda0b6354565b8854d48032f318e', 'request_id': 'req-defd0c7b-6de3-43a0-a448-b4b19decc723'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:42.665445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e869eda0b6354565b8854d48032f318e', 'request_id': 'req-defd0c7b-6de3-43a0-a448-b4b19decc723'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:42.685992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e869eda0b6354565b8854d48032f318e', 'request_id': 'req-defd0c7b-6de3-43a0-a448-b4b19decc723'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:42.707417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] The token cache is being invalidate because project e869eda0b6354565b8854d48032f318e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:39:42.708027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:42.708880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-defd0c7b-6de3-43a0-a448-b4b19decc723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:42.710851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1227/2458] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:39:42 2022] DELETE /identity/v3/projects/e869eda0b6354565b8854d48032f318e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:42.716257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:42.716864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:42.716975 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:42.742648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:42.743910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:42.749234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:42.924621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1232/2459] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:42.933267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:42.933552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:42.934298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:42.967976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:42.969223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:42.993981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1228/2460] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:42.997973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.019289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849d067-f230-4281-8e77-3903d47e2f0f None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.027319 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.028447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.028866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.029208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.030296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:39:43.030647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.032943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.049339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1233/2461] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:39:43.053338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.064614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4573b6-1528-4234-9648-d5398a193fc2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.071166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.072572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.073163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.073544 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.074817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.078315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.132077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.155607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1229/2462] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:39:43 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:43.157689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a663bf-70fa-489f-a739-bf6980c3027f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.322322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.323091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.323326 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.323563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.325033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.326999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.370827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1234/2463] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:39:43 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:43.378860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.410628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdefa2-1042-46b9-b3b8-8b1d30025bbe admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.443039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.444542 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.444930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.445306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.450959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.459739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.486873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1230/2464] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:43.487885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.503197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90af4c6b-a957-4002-9869-1990dcff8ab1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.526821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.527630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.527914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.528190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.528956 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.530710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9937dcd-e2b0-4695-b6e6-eec854f80104 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.554180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1235/2465] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:43.558978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:43.576644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a140d7-265d-45f8-b54c-5e313dd172b0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:43.587454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:43.588761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.593826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.594405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] PATH_INFO: `/v3/projects/be13aa2616dd46178014348c9778fd01/users/510c86375cc54cc1b84b2dc05b11fbcf/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.654103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be13aa2616dd46178014348c9778fd01, user_id=510c86375cc54cc1b84b2dc05b11fbcf, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:43.663867 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fb33b9-35c2-46e8-afb8-fc74cf38d0d4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:43.726115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1231/2466] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:43 2022] PUT /identity/v3/projects/be13aa2616dd46178014348c9778fd01/users/510c86375cc54cc1b84b2dc05b11fbcf/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:43.728389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.728959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.728959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.817591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] MFA Rules not processed for user `510c86375cc54cc1b84b2dc05b11fbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:43.821703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:43.853019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:43.853394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:43.853576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:43.916741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] MFA Rules not processed for user `5a2f77cdf786411faad0acd1da264c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:43.918809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:43.961330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:44.016662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1236/2467] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:44.030542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:44.035492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:44.046261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:44.104856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1232/2468] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:43 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:44.112084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:44.114725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:44.163639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cacc83-10e2-4043-887c-02fd6916cb40 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:44.192897 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:44.193627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:44.193914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:44.194180 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:44.220760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:44.222433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be390b2-10d9-4bd7-ac17-96aacfca9703 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:44.233710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1237/2469] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:39:44.370555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f51844-83cd-4a15-9500-9a406e46d181 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:44.379644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:44.380325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:44.380607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:44.380934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:44.385056 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:44.518760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:44.524689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4268d2d0-93ab-4790-8cc5-1f8790ea830e service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:44.542162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1233/2470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:39:46.587764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729dff-757d-488d-b82b-22d20c95fcaf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:46.588520 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729dff-757d-488d-b82b-22d20c95fcaf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:46.588664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25729dff-757d-488d-b82b-22d20c95fcaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:46.614102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-25729dff-757d-488d-b82b-22d20c95fcaf None None] MFA Rules not processed for user `c0579a5ba91a4aa89b676598b6d9dfeb`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:46.615987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-25729dff-757d-488d-b82b-22d20c95fcaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:46.626699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1238/2471] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:47.131991 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:47.133562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:47.134030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:47.155326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] MFA Rules not processed for user `510c86375cc54cc1b84b2dc05b11fbcf`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:47.157393 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:47.185750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1234/2472] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:53.688587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:53.689218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:53.689218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:53.709379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:53.710641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:53.779514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1239/2473] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:39:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:53.793171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:53.794701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:53.823784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:53.873152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543e2353-6b43-4e32-bdfd-7e390c517b67 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:53.879576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:53.880286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:53.880557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:53.880834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:53.891263 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:53.892938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:53.901936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1235/2474] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:39:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:39:56.741811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:56.743294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:56.838354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1d9f5-78b8-407f-b8fb-5bd8ffb4aa63 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:56.845936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:56.847131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:56.847513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:56.847883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] PATH_INFO: `/v3/users/0e92ccbb22394817bd8a4224cc0d4e13` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:56.849503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e92ccbb22394817bd8a4224cc0d4e13)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:56.851638 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:56.943647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e92ccbb22394817bd8a4224cc0d4e13'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:56.945404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:56.955853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e92ccbb22394817bd8a4224cc0d4e13'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:56.957165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e92ccbb22394817bd8a4224cc0d4e13'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:56.975191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e92ccbb22394817bd8a4224cc0d4e13'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:56.975787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-01ea61cd-0d6a-406f-8eb7-ba181579f359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e92ccbb22394817bd8a4224cc0d4e13'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.005404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1240/2475] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:39:56 2022] DELETE /identity/v3/users/0e92ccbb22394817bd8a4224cc0d4e13 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:57.222943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.235501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b962d647-a328-492a-9836-124d2ab14444 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.306572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.307505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.307956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.308342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] PATH_INFO: `/v3/projects/b902945afee143b19beb3366841fd72d` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.309868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b902945afee143b19beb3366841fd72d)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.311861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.361435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b902945afee143b19beb3366841fd72d', 'request_id': 'req-9bef0c5c-f137-4af7-a08b-18f8174052f1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.370368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b902945afee143b19beb3366841fd72d', 'request_id': 'req-9bef0c5c-f137-4af7-a08b-18f8174052f1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.379546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b902945afee143b19beb3366841fd72d', 'request_id': 'req-9bef0c5c-f137-4af7-a08b-18f8174052f1'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.401865 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] The token cache is being invalidate because project b902945afee143b19beb3366841fd72d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:39:57.402195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.402880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9bef0c5c-f137-4af7-a08b-18f8174052f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:39:57.404570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1236/2476] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:39:57 2022] DELETE /identity/v3/projects/b902945afee143b19beb3366841fd72d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:57.409962 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.410270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.410565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.435718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:57.437046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:57.515622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1241/2477] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:39:57.523702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.523988 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.524264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.552278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:57.553556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:57.567611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1237/2478] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:57.574580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.595924 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02757c-594b-4fd3-8f72-caa8234064fc None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.604051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.605288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.605654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.605909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.606725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:39:57.607035 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.608709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.624143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1242/2479] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:39:57.629764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.640068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c5ae7-b829-4cfb-9c83-7e0459f61e89 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.645045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.645725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.646005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.646311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.647032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.649007 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.678698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1238/2480] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:39:57 2022] POST /identity/v3/projects => generated 369 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:57.683286 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.694205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f28cc-c4c6-4556-a16e-eb4b101cb562 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.784284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.785031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.785176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.785382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.786483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.788726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.816944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1243/2481] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:39:57 2022] POST /identity/v3/users => generated 285 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:39:57.822529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.839969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a4324-6f77-4d88-b706-8cb532617fa6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.845646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.846443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.846732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.847055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.847965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.849750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.863815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1239/2482] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:57.868219 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.879843 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ae5b5-27aa-4aa0-8912-4ab99a3771fe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.884934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.885621 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.886155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.886459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.887535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.889289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367850a-eabd-4f9a-b10d-562f5ec2c996 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:57.916602 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1244/2483] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:39:57.922874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:57.929794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:57.945310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702cb2d6-cf77-490c-b4af-bdee0706cc73 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:57.958897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:57.960460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:57.960978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:57.961457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] PATH_INFO: `/v3/projects/7e955d6fe14f487dafb08281e11c493a/users/0314ca9141764676bfbb4238fe62ccf5/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:57.989873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e955d6fe14f487dafb08281e11c493a, user_id=0314ca9141764676bfbb4238fe62ccf5, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:57.992789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:58.009938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1240/2484] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:39:57 2022] PUT /identity/v3/projects/7e955d6fe14f487dafb08281e11c493a/users/0314ca9141764676bfbb4238fe62ccf5/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:39:58.023294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c704-95ca-47e4-96ba-b9efa6278d65 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:58.023596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c704-95ca-47e4-96ba-b9efa6278d65 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:58.023758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d17c704-95ca-47e4-96ba-b9efa6278d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:58.055314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4d17c704-95ca-47e4-96ba-b9efa6278d65 None None] MFA Rules not processed for user `0314ca9141764676bfbb4238fe62ccf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:39:58.056552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4d17c704-95ca-47e4-96ba-b9efa6278d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:58.078267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:39:58.130874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1245/2485] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:39:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:39:58.148759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:39:58.151081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:39:58.250225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a658b-9757-42f3-a467-ba90e8ba31cc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:39:58.254610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:39:58.255279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:39:58.255560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:39:58.255833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:39:58.267148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:39:58.268646 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120906c-9dd5-4aa4-a439-29f305de37cc service glance] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:39:58.283086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1241/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:39:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:40:08.127630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=18 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:08.275403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:19.559290 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:19.559867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:19.559867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:19.583212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] MFA Rules not processed for user `3eb8cf247b6b4d6981191b804790f5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:19.584448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:19.652757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1246/2487] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:40:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:24.670657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc1e0-b9c0-42e1-99ed-aad4e47b174a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:24.671430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc1e0-b9c0-42e1-99ed-aad4e47b174a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:24.671430 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7bc1e0-b9c0-42e1-99ed-aad4e47b174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:24.691154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5e7bc1e0-b9c0-42e1-99ed-aad4e47b174a None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:24.692403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5e7bc1e0-b9c0-42e1-99ed-aad4e47b174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:24.766335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1242/2488] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:40:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:24.801006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:24.803339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:24.886343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58292e4-8a7a-455e-8728-4070d238e583 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:24.893266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:24.894193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:24.895060 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:24.895371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:24.905136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:24.906906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:24.918010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1247/2489] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:40:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:40:25.574358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ecf3-84c9-4121-912d-bf5cdcad9ce7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:25.574639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ecf3-84c9-4121-912d-bf5cdcad9ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:25.574923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2261ecf3-84c9-4121-912d-bf5cdcad9ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:25.603017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2261ecf3-84c9-4121-912d-bf5cdcad9ce7 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:25.604253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2261ecf3-84c9-4121-912d-bf5cdcad9ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:25.613355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1243/2490] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:25.626967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:25.640335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098aa3e-03ef-407d-96d4-9262c3df2a98 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:25.646216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:25.646888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:25.647169 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:25.647441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:25.657596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:25.659572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:25.669456 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1248/2491] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:40:25.918471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23579-eea4-465a-b595-8e415517824d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:25.918980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23579-eea4-465a-b595-8e415517824d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:25.919095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a23579-eea4-465a-b595-8e415517824d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:25.940108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-b0a23579-eea4-465a-b595-8e415517824d None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:25.941396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b0a23579-eea4-465a-b595-8e415517824d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:25.949505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1244/2492] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:40:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:25.963669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:25.975926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a258286-b90f-4d0b-bbb7-d8e92495c2ee service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:25.981932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:25.982635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:25.982919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:25.983194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:25.993011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:25.994687 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:26.004227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1249/2493] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:40:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:40:26.430717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:26.431134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:26.431509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:26.454976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:26.456699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:26.470439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1245/2494] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:40:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:26.481997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:26.498620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155436f-4ae0-45c6-894b-1a1d84007bd6 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:26.508710 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:26.510435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:26.511268 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:26.511917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:26.529549 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:26.536697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc564df1-3788-40b8-81dc-6f94058af6eb service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:26.551484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1250/2495] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:40:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 10:40:29.107178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:29.109171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:29.208665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc17372-56c5-4e80-a4e9-5fdd4733c41b None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:29.224074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:29.225219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:29.225604 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:29.225966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] PATH_INFO: `/v3/users/510c86375cc54cc1b84b2dc05b11fbcf` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:29.227498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=510c86375cc54cc1b84b2dc05b11fbcf)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:29.229657 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:29.292723 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '510c86375cc54cc1b84b2dc05b11fbcf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:29.303063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '510c86375cc54cc1b84b2dc05b11fbcf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:29.318935 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '510c86375cc54cc1b84b2dc05b11fbcf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:29.319881 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '510c86375cc54cc1b84b2dc05b11fbcf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:29.330439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '510c86375cc54cc1b84b2dc05b11fbcf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:29.354788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1246/2496] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:40:29 2022] DELETE /identity/v3/users/510c86375cc54cc1b84b2dc05b11fbcf => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:40:29.362857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:29.363818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:29.363818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:29.390246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:40:29.391809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:29.451148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:29.470159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1251/2497] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:40:29.481241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:29.483388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:29.492490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:29.615900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675515a-bedc-404b-88ae-035454520ab4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:29.623068 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:29.624288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:29.624859 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:29.625426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:29.644537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:29.647458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:29.668349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1247/2498] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:40:29.992702 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:29.994725 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:30.014134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa9ffc8-3a02-4f62-af53-1f482b9253fd None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:30.025385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:30.026200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:30.026698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:30.027311 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] PATH_INFO: `/v3/projects/be13aa2616dd46178014348c9778fd01` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:30.029049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be13aa2616dd46178014348c9778fd01)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:30.031839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:30.117445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be13aa2616dd46178014348c9778fd01', 'request_id': 'req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:30.125076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be13aa2616dd46178014348c9778fd01', 'request_id': 'req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:30.134389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be13aa2616dd46178014348c9778fd01', 'request_id': 'req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:30.154516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] The token cache is being invalidate because project be13aa2616dd46178014348c9778fd01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:40:30.154907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:30.156229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:40:30.157594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1252/2499] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:40:29 2022] DELETE /identity/v3/projects/be13aa2616dd46178014348c9778fd01 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:40:30.239251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:30.250517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a1fe3-56a6-40cd-86dd-e55db9e9d46f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:30.330152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:30.331038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:30.331382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:30.331784 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:30.334240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:30.443383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:30.445684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:30.461914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1248/2500] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:40:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:40:33.103193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:33.105525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:33.124779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d687c-5f3c-4843-ba9b-6c1b3bfabd09 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:33.129931 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:33.130760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:33.131198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:33.131588 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:33.134047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:33.149728 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:33.151279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:33.164211 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1253/2501] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:40:40.048436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:40:40.050172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:40.065373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1492a8cb-9032-4959-8d4e-37e79c6543ac service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:40:40.071751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:40:40.072491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:40:40.072818 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:40:40.073146 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:40:40.075310 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:40:40.134628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:40.151405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:40:40.153138 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:40:40.164786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1249/2502] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:40:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:40:43.158508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=35,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:40:50.159224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:10.954965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:10.956637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:10.968106 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44324f-512e-4ebf-a7ed-debb2d955e27 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:10.972012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:10.972656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:10.972954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:10.973221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:10.975157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:11.058927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:11.060791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:11.071447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1254/2503] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:10 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:13.160726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:13.162227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:13.177792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034bf9b6-9d9b-40f5-beae-2944363f3c43 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:13.191325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:13.192126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:13.192446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:13.192795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:13.195030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:13.211044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:13.213212 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:13.227149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1250/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:13.346091 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:13.355854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c7a74-8571-4644-b5fe-a77a2af82308 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:13.360603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:13.361273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:13.361556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:13.361831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:13.363814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:13.383761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:13.385245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4213f7e8-e5c3-403c-a7df-120599fc19a9 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:13.395356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1255/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:15.797615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:15.799259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:15.868241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d6b4dc-ddbe-4356-8fd3-f05ae75fe05a service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:15.873011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:15.873877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:15.874746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:15.875019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] PATH_INFO: `/v3/users/0314ca9141764676bfbb4238fe62ccf5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:15.876351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0314ca9141764676bfbb4238fe62ccf5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:15.878335 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:15.934838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0314ca9141764676bfbb4238fe62ccf5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:15.942374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0314ca9141764676bfbb4238fe62ccf5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:15.954861 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0314ca9141764676bfbb4238fe62ccf5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:15.955502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0314ca9141764676bfbb4238fe62ccf5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:15.962752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0314ca9141764676bfbb4238fe62ccf5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:15.969465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1251/2506] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:41:15 2022] DELETE /identity/v3/users/0314ca9141764676bfbb4238fe62ccf5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:41:15.973995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:15.974506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:15.974603 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:15.992028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:15.993103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:16.058444 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1256/2507] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:16.068405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.070081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:16.132141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4196e-bc03-47bd-a09d-b8aa15746a82 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.135806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.136453 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.136734 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.137028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.146235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.147674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e3e9e2-0333-49e5-a291-3d82f2ce361f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.157176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1252/2508] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:16.461424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.462966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:16.475824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74597cb0-aa4d-4a6c-ab80-2520200ce879 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.481354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.482387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.482677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.483480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] PATH_INFO: `/v3/projects/7e955d6fe14f487dafb08281e11c493a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.484841 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e955d6fe14f487dafb08281e11c493a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.486833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.540868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e955d6fe14f487dafb08281e11c493a', 'request_id': 'req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:16.547925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e955d6fe14f487dafb08281e11c493a', 'request_id': 'req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:16.554709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e955d6fe14f487dafb08281e11c493a', 'request_id': 'req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:16.569345 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] The token cache is being invalidate because project 7e955d6fe14f487dafb08281e11c493a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:41:16.569552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:16.570292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-1441cb5a-447b-4c72-af6e-1dec3f1f04ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:16.571967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1257/2509] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:41:16 2022] DELETE /identity/v3/projects/7e955d6fe14f487dafb08281e11c493a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:41:16.577536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.577820 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.578130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.597183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:16.598488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:16.603512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:16.672467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1253/2510] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:16.684987 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.685470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.685941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.694734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:16.708840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:16.710641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:16.718895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1258/2511] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:16.723315 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.733411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3063630a-6246-485c-b904-271b0f9a5e2a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.741194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.742240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.742658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.742995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.744109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:41:16.744593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.747177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.761427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1254/2512] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:41:16.768626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.782239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9efff-ad08-4a4d-b8bf-8cd8e5567b84 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.787718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.788378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.788675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.788953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.789643 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.791649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.821466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1259/2513] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:41:16 2022] POST /identity/v3/projects => generated 369 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:16.826711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.841102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56178b4a-bb1b-48e4-8b94-8db4af451634 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.904762 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.905758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.906039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.906369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.907062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.909003 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.931741 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1255/2514] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:41:16 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:16.938241 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.949036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839b4f7-d481-4308-9ba4-6a5fd7dc90c4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.955440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.956097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.956374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.956654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.957371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.959020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:16.970689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1260/2515] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:16.975112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:16.985751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59885d5e-4251-4630-a8a8-64b086dc34e8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:16.990621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:16.991286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:16.991573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:16.991871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:16.992591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:16.994234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b148d-7371-4d1e-b8f5-76c75fc88096 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:17.004764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1256/2516] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:17.009786 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:17.025964 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d992b8-1916-44ea-9354-d51be30e478b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:17.032600 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:17.033491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:17.033785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:17.034084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] PATH_INFO: `/v3/projects/858096989cb649a59710d3fe227a9f53/users/8a0575cc3f0d456cba83adb46416f7a4/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:17.051213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=858096989cb649a59710d3fe227a9f53, user_id=8a0575cc3f0d456cba83adb46416f7a4, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:17.054082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:17.070295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1261/2517] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:41:17 2022] PUT /identity/v3/projects/858096989cb649a59710d3fe227a9f53/users/8a0575cc3f0d456cba83adb46416f7a4/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:41:17.088792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:17.089230 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:17.089720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:17.121331 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] MFA Rules not processed for user `8a0575cc3f0d456cba83adb46416f7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:17.122585 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:17.192912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1257/2518] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:17.205375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:17.207217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:17.271303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac66687-4321-44b0-bbf2-8a08cd3a3adc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:17.276171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:17.276831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:17.277193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:17.277498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:17.287249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:17.288726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:17.300642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1262/2519] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:27.189512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:27.295828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=51,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:51.886433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:51.887912 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:51.954124 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:51.957407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:51.977684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e6c8dd-eb78-4f4d-a38f-bb39469cb27f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:51.983155 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:51.983856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:51.984159 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:51.984442 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:51.986433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:51.998775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.000429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.013183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1258/2520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:52.050854 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6359dab9-9a32-4fa8-971d-f78f79448029 service glance] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.055476 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.056534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.056807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.057080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] PATH_INFO: `/v3/users/3eb8cf247b6b4d6981191b804790f5f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.058395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3eb8cf247b6b4d6981191b804790f5f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.060480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.115094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3eb8cf247b6b4d6981191b804790f5f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.123516 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3eb8cf247b6b4d6981191b804790f5f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.124400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3eb8cf247b6b4d6981191b804790f5f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.134462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3eb8cf247b6b4d6981191b804790f5f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.135276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-4b24af4d-2077-438a-8bc1-2f619856b340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3eb8cf247b6b4d6981191b804790f5f0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.156136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1263/2521] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:41:51 2022] DELETE /identity/v3/users/3eb8cf247b6b4d6981191b804790f5f0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:41:52.361032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.373576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23046f51-9d5a-4756-955a-6d704593a82e service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.448119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.449009 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.449293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.449564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] PATH_INFO: `/v3/projects/849b037f3f424220b53da5537c2cebf3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.451193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=849b037f3f424220b53da5537c2cebf3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.453131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.506637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '849b037f3f424220b53da5537c2cebf3', 'request_id': 'req-0ef106ad-b204-4ee8-8b66-531dbaeea050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.514780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '849b037f3f424220b53da5537c2cebf3', 'request_id': 'req-0ef106ad-b204-4ee8-8b66-531dbaeea050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.522018 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '849b037f3f424220b53da5537c2cebf3', 'request_id': 'req-0ef106ad-b204-4ee8-8b66-531dbaeea050'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.533562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] The token cache is being invalidate because project 849b037f3f424220b53da5537c2cebf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:41:52.533813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.534565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0ef106ad-b204-4ee8-8b66-531dbaeea050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:41:52.536156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1259/2522] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:41:52 2022] DELETE /identity/v3/projects/849b037f3f424220b53da5537c2cebf3 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:41:52.547509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.547906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.548007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.567335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:52.568570 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:52.643912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1264/2523] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:52.652399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.652693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.652974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.674035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:52.675376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:52.684312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1260/2524] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:41:52.688889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.700633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61562a5-cf5c-4747-8976-6ab04580d30a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.707382 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.708067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.708350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.708625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.709369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:41:52.709681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.711393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.725090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1265/2525] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:41:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:41:52.729779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.740624 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914d3a4-47b6-45a1-b5f3-75aef493ccf5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.746462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.747162 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.747441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.747714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.748422 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.750457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.761001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:52.792717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1261/2526] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:41:52 2022] POST /identity/v3/projects => generated 379 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:52.797633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.808289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0511a5b-c152-4b02-8c6a-a2eb3d2b024a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.812275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:52.875240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.875926 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.876204 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.876560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.877851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.879808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.908208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1266/2527] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:41:52 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:52.912066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.925481 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3a249-db46-4e1b-90ba-71f265e59883 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.932630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.933605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.934017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.934435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.935591 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.938084 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.948530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1262/2528] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:52.953235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:52.964185 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533591a6-56cd-454f-8dea-583a42a5c7dc admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:52.969852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:52.971067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:52.971855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:52.971855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:52.972408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:52.974028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ba1e1-2368-4599-8b13-ecb556e502e2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:52.984626 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1267/2529] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:52.989197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:53.008115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e5fd81-fc73-447c-a2a0-9460b25404d5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:53.018136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:53.019746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:53.020260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:53.020764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] PATH_INFO: `/v3/projects/25adacdcc5b44375b112a93f8623802c/users/f9eaebabd54a45a29f262b67fe1c433b/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:53.048278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] RBAC: Authorizing `identity:create_grant(project_id=25adacdcc5b44375b112a93f8623802c, user_id=f9eaebabd54a45a29f262b67fe1c433b, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:53.052921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:53.069023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1263/2530] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:41:52 2022] PUT /identity/v3/projects/25adacdcc5b44375b112a93f8623802c/users/f9eaebabd54a45a29f262b67fe1c433b/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:41:53.074496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab77bc-3c23-4483-9b9e-aa0ae700fcef None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:53.075162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab77bc-3c23-4483-9b9e-aa0ae700fcef None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:53.075431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deab77bc-3c23-4483-9b9e-aa0ae700fcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:53.096395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-deab77bc-3c23-4483-9b9e-aa0ae700fcef None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:53.096737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-deab77bc-3c23-4483-9b9e-aa0ae700fcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:53.171196 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1268/2531] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:41:53.182443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:53.185504 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:53.257531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a430aa6a-841e-4b85-95f5-1aa069eb554f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:53.261381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:53.262015 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:53.262330 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:53.262599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:53.274206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:53.275686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:53.286780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1264/2532] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:41:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:41:57.808608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:57.809544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:57.809544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:57.871318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] MFA Rules not processed for user `f9eaebabd54a45a29f262b67fe1c433b`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:41:57.874583 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:41:58.042288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1269/2533] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:41:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:41:58.047898 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.061704 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695884-8513-461a-8ef8-629a58763475 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.067369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.068101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.068384 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.068653 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.069621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.073269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.109180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1265/2534] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:41:58 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:58.113659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.127678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c4b1f-0549-4396-aff7-2f17531fd766 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.141630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:41:58.211491 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.212270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.212535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.212804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.213526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.215567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.239985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1270/2535] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:41:58 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:41:58.242920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.260000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67f070-fed9-4e4e-b53e-735c4372d90e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.260000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.260651 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.260819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.261099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.261773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.263553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.278467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1266/2536] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:58.283041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.293758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237add1-d6d8-4a46-8f17-05a42b4f7d7c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.299134 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.299971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.301502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.301741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] PATH_INFO: `/v3/projects/6ed62d92b8514448a97c06f7bb21453b/users/0b87af2c436340c69448d88eba87dc92/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.319591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed62d92b8514448a97c06f7bb21453b, user_id=0b87af2c436340c69448d88eba87dc92, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.322378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.341235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1271/2537] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:41:58 2022] PUT /identity/v3/projects/6ed62d92b8514448a97c06f7bb21453b/users/0b87af2c436340c69448d88eba87dc92/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:41:58.345979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.357446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d94b1b-a15b-40ff-a3e1-cb0f5028cbf7 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.431552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.432619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.433040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.433568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.434878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.437575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb75507-badd-4448-bed9-28851c785d25 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.451288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1267/2538] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:41:58 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:41:58.456322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:41:58.473804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67246fbc-bf28-4062-905e-1407e755a254 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:41:58.484634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:41:58.484860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:41:58.487733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:41:58.487733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] PATH_INFO: `/v3/projects/6ed62d92b8514448a97c06f7bb21453b/users/0b87af2c436340c69448d88eba87dc92/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:41:58.489284 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed62d92b8514448a97c06f7bb21453b, user_id=0b87af2c436340c69448d88eba87dc92, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:41:58.493561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:41:58.509429 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1272/2539] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:41:58 2022] PUT /identity/v3/projects/6ed62d92b8514448a97c06f7bb21453b/users/0b87af2c436340c69448d88eba87dc92/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:42:04.286809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:04.288251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:04.288998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:04.323275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:04.330370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] MFA Rules not processed for user `0b87af2c436340c69448d88eba87dc92`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:42:04.332352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:04.419458 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1268/2540] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:42:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:42:04.437343 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:04.440529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:04.552805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321372b7-c0fb-4e79-aadc-97dba85753a2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:04.568508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:04.568508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:04.568508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:04.568508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:04.680330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:04.682167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf75d3-27d2-4973-beaf-961a79c4dd44 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:04.693888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1273/2541] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:08.278805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:08.280561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:08.376034 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b8ef2b-a027-4a82-a1b5-0796d93aa52a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:08.383424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:08.384509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:08.385037 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:08.385385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] PATH_INFO: `/v3/users/8a0575cc3f0d456cba83adb46416f7a4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:08.387171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0575cc3f0d456cba83adb46416f7a4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:08.389945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:08.494313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0575cc3f0d456cba83adb46416f7a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:08.510283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0575cc3f0d456cba83adb46416f7a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:08.545240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0575cc3f0d456cba83adb46416f7a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:08.546539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0575cc3f0d456cba83adb46416f7a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:08.560252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0575cc3f0d456cba83adb46416f7a4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:08.572253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1269/2542] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:42:08 2022] DELETE /identity/v3/users/8a0575cc3f0d456cba83adb46416f7a4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:42:08.579291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:08.580560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:08.580912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:08.588659 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:08.604682 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:42:08.606327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:08.701972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1274/2543] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:42:08.715067 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:08.717031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:08.747425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:08.807109 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68e28c-1246-404b-a795-25d44533272b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:08.813193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:08.814565 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:08.815397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:08.815874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:08.830235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:08.831930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d6a50-4401-4f4a-bdde-c1b682e7f8d0 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:08.846193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1270/2544] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:09.204159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:09.206186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:09.221314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242920c-a1c5-41d3-b506-aea3f7c1bbe6 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:09.233068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:09.234065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:09.234356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:09.234630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] PATH_INFO: `/v3/projects/858096989cb649a59710d3fe227a9f53` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:09.236070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858096989cb649a59710d3fe227a9f53)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:09.239159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:09.332763 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858096989cb649a59710d3fe227a9f53', 'request_id': 'req-cf05beb4-fff5-4e96-b739-8716609f91d0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:09.342744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858096989cb649a59710d3fe227a9f53', 'request_id': 'req-cf05beb4-fff5-4e96-b739-8716609f91d0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:09.356386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858096989cb649a59710d3fe227a9f53', 'request_id': 'req-cf05beb4-fff5-4e96-b739-8716609f91d0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:09.375455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] The token cache is being invalidate because project 858096989cb649a59710d3fe227a9f53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:42:09.376043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:09.377957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:42:09.380613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1275/2545] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:42:09 2022] DELETE /identity/v3/projects/858096989cb649a59710d3fe227a9f53 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:42:18.839224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=18 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:19.370428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:29.935904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:29.936541 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:29.936637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:29.960980 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] MFA Rules not processed for user `f9eaebabd54a45a29f262b67fe1c433b`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:42:29.962813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:30.031751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1271/2546] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:42:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:42:30.428619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:30.430316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:30.495479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05beb4-fff5-4e96-b739-8716609f91d0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:30.499385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:30.500053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:30.500339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:30.500618 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:30.502567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:30.513645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:30.515170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:30.524277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1276/2547] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:31.015686 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:31.017899 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:31.099153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fb313-b5c1-41e4-91d8-313061338102 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:31.104173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:31.104829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:31.105108 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:31.105579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:31.107537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:31.121217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:31.123035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:31.134543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1272/2548] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:32.237890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:32.239632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:32.332293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a3bcc-f30b-4f9e-8a1d-7e2a9f52c24e service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:32.340918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:32.341568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:32.341850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:32.342158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:32.344093 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:32.439095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:32.439095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:32.458367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1277/2549] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:41.129745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=57 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:42.444884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=82 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:42:49.195464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:49.197006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:49.215198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4615984-7de8-495f-a6d0-b21500e920d8 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:49.222693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:49.223849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:49.224348 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:49.225020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:49.228097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:49.263424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:49.265086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:49.279437 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1273/2550] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:52.954669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:52.956252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:52.969904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c66979-716a-429a-b726-27f4d5b5db77 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:52.973747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:52.974471 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:52.974789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:52.975148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:52.977585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:53.054080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:53.055949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2dcb81-6dbc-4fb6-a333-c5e6b5068ec5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:53.069637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1278/2551] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:42:54.922824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:42:54.940909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374fa0a-bd65-4001-98ab-7d908fb67830 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:42:54.947431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:42:54.948228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:42:54.948506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:42:54.949119 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:42:54.951066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:42:54.964144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:42:54.965803 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:42:54.977434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1274/2552] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:42:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:43:03.062031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=30 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:04.972381 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:43:13.224097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b56a6-067a-463a-8a7a-843618e9b7b5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:43:13.224656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b56a6-067a-463a-8a7a-843618e9b7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:43:13.224656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b56a6-067a-463a-8a7a-843618e9b7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:43:13.244473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1e5b56a6-067a-463a-8a7a-843618e9b7b5 None None] MFA Rules not processed for user `9bbb5d4487874bdd9f82e28651a418f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:43:13.245681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1e5b56a6-067a-463a-8a7a-843618e9b7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:43:13.254390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1279/2553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:43:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:43:23.239339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:17.652186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:17.664476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b8ee3-c6cc-4cfe-947c-fa5ab5ac6a97 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:17.670280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:17.670824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:17.671112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:17.671371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:17.673214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:17.686497 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:17.688101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:17.700790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1275/2554] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:20.650928 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d7d2-1a39-461d-9b42-f7531c2341d7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:20.651572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d7d2-1a39-461d-9b42-f7531c2341d7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:20.651572 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc7d7d2-1a39-461d-9b42-f7531c2341d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:20.671148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cdc7d7d2-1a39-461d-9b42-f7531c2341d7 None None] MFA Rules not processed for user `f58d6e222d654e66b38fcefeff65fe80`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:20.673055 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cdc7d7d2-1a39-461d-9b42-f7531c2341d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:20.752617 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1280/2555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:44:21.090619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:21.101614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aafcd0-e1f5-4ea9-ac06-d3e7f8de5e9f service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:21.106811 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:21.107477 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:21.107757 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:21.108101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:21.110246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:21.122362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:21.123821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138a412f-70bc-4fcf-a524-957eebe5f664 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:21.133639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1276/2556] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:30.745227 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=25 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:31.129259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:39.492515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a8c3e-d266-4a42-bf99-94096ac5c1ba None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.493150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a8c3e-d266-4a42-bf99-94096ac5c1ba None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.493150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a8c3e-d266-4a42-bf99-94096ac5c1ba None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.494679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1281/2557] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:44:39.501592 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1368f7-cc7e-4e5d-8b33-03389a7a73b0 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.502169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1368f7-cc7e-4e5d-8b33-03389a7a73b0 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.502169 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1368f7-cc7e-4e5d-8b33-03389a7a73b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.522788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0e1368f7-cc7e-4e5d-8b33-03389a7a73b0 None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:39.524024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0e1368f7-cc7e-4e5d-8b33-03389a7a73b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:39.531223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1277/2558] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:44:39.545772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a8c3e-d266-4a42-bf99-94096ac5c1ba None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:39.558771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a8c3e-d266-4a42-bf99-94096ac5c1ba None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:39.564646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:39.565750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.565989 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.566308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.581013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:39.582533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc4323-19b2-48f1-b0e8-8d0955f3a80f service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:39.591732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1282/2559] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:39.694667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbaa4-ec05-4323-a2c7-3613ec30cca7 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.694979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbaa4-ec05-4323-a2c7-3613ec30cca7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.695255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957dbaa4-ec05-4323-a2c7-3613ec30cca7 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.697602 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1278/2560] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:44:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:44:39.704821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.705109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.705381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.759231 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:39.760688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:39.772302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1283/2561] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:44:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:44:39.784534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dbaa4-ec05-4323-a2c7-3613ec30cca7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:39.796069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957dbaa4-ec05-4323-a2c7-3613ec30cca7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:39.799893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:39.800740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:39.801023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:39.801299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:39.814128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:39.815627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:39.828157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1279/2562] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:44.285398 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:44.297297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3a708-6f6e-4468-b8c0-f86a3b6a8a4c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:44.303249 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:44.304033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:44.304384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:44.304647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:44.306538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:44.387743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:44.389644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:44.400674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1284/2563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:46.595216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:46.605678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f688034-623a-44d3-b3af-c48ea7c049e6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:46.609386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:46.610045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:46.610352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:46.610626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:46.612746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:46.683136 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:46.684603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:46.696492 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1280/2564] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:50.306089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:50.318777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eef157-c9b8-457b-84e0-1a4840442190 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:50.324323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:50.325053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.325262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.325537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.329822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:50.342495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:50.344141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:50.358370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1285/2565] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:50.372489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:50.374523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:50.390496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093a0e-2426-43f1-949c-3bb1902a520c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:50.397021 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:50.397854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.398287 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.398569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] PATH_INFO: `/v3/users/9bbb5d4487874bdd9f82e28651a418f9` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.400023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbb5d4487874bdd9f82e28651a418f9)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:50.403239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:50.456710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbb5d4487874bdd9f82e28651a418f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.465025 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbb5d4487874bdd9f82e28651a418f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.477519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbb5d4487874bdd9f82e28651a418f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.478255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbb5d4487874bdd9f82e28651a418f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.485940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5eaca54-b122-49df-88be-8df416fa38d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbb5d4487874bdd9f82e28651a418f9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.492110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1281/2566] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:44:50 2022] DELETE /identity/v3/users/9bbb5d4487874bdd9f82e28651a418f9 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:44:50.679645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:50.691575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95629e1d-2837-4b48-9513-d2a4503d0867 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:50.756651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:50.757529 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.757808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.758087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] PATH_INFO: `/v3/projects/3ddb0def61dd452db3588952af149fb7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.759274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddb0def61dd452db3588952af149fb7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:50.761357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:50.813075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddb0def61dd452db3588952af149fb7', 'request_id': 'req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.817226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:50.819884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddb0def61dd452db3588952af149fb7', 'request_id': 'req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.828141 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddb0def61dd452db3588952af149fb7', 'request_id': 'req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.842762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] The token cache is being invalidate because project 3ddb0def61dd452db3588952af149fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:44:50.843024 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.843680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-dfe0dc7e-3352-43f0-9e67-c0530553f0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:44:50.845295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1286/2567] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:44:50 2022] DELETE /identity/v3/projects/3ddb0def61dd452db3588952af149fb7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:44:50.850377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.850663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.850940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.868776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:50.870647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:50.917239 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:50.937729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1282/2568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:44:50.945498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.945817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.946132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.966115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:50.967250 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:50.975524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1287/2569] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:44:50.980389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:50.990410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac68ae-3590-418b-aa25-7e83c4d1fad4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:50.996087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:50.996739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:50.997017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:50.997288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:50.998017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:44:50.998357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:50.999954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.012553 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1283/2570] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:44:51.019186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.034370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2aca3e-346d-4f6c-ab52-2db8c8b36f6c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.042039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.042712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.043017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.043289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.044122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.046127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.078877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1288/2571] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:44:51 2022] POST /identity/v3/projects => generated 387 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:44:51.083421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.094638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31475-a2d3-4c76-ae48-0ba4da9c21e0 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.162010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.162885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.163249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.163494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.164385 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.167398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.195752 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1284/2572] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:44:51 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:44:51.201057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.214507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912af92-c704-4923-a3f9-cb617a8c548d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.223825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.224510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.224849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.225127 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.225903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.227666 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.240027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1289/2573] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:44:51.244595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.256904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba170574-54a1-464b-8a8f-33c5ef1ea71f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.261983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.262703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.262978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.263246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.263983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.265621 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bdc94c-0d71-44ee-8f3e-b5eb6de8f5c7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.276304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1285/2574] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:44:51.280959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.291464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ba933-d621-4e95-90bd-a43a0884bb36 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.297222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.298358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.298838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.299226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] PATH_INFO: `/v3/projects/136181b906064188b6d06ca200fb9037/users/6a75b9c7a5bc4959b27d5c5b87b9c1cd/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.316152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136181b906064188b6d06ca200fb9037, user_id=6a75b9c7a5bc4959b27d5c5b87b9c1cd, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.320160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.336938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1290/2575] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:44:51 2022] PUT /identity/v3/projects/136181b906064188b6d06ca200fb9037/users/6a75b9c7a5bc4959b27d5c5b87b9c1cd/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:44:51.342389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203444-4358-4be3-9750-f9c795718254 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.342726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203444-4358-4be3-9750-f9c795718254 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.343002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e203444-4358-4be3-9750-f9c795718254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.365675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3e203444-4358-4be3-9750-f9c795718254 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:51.366985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3e203444-4358-4be3-9750-f9c795718254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:51.430323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1286/2576] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:44:51.443712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:51.445526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:51.506435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e901cf-a02d-4b6e-9c9c-5090e098d4b7 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:51.510639 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:51.511270 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:51.511539 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:51.511846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:51.521804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:51.523322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:51.533589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1291/2577] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:55.745719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6374dcf-2d3b-4b67-a644-4e363d5fdcc9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:55.746304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6374dcf-2d3b-4b67-a644-4e363d5fdcc9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:55.746304 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6374dcf-2d3b-4b67-a644-4e363d5fdcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:55.774939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a6374dcf-2d3b-4b67-a644-4e363d5fdcc9 None None] MFA Rules not processed for user `6a75b9c7a5bc4959b27d5c5b87b9c1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:55.777700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a6374dcf-2d3b-4b67-a644-4e363d5fdcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:55.824812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:44:55.850311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1287/2578] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:44:55.865530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:44:55.867105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:55.946328 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d555a11-8226-4f2e-8f44-2b6bce409cd5 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:44:55.953027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:44:55.953694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:55.953977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:55.954283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:55.963943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:44:55.965844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd2667-2331-4043-a5fb-aaef73343280 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:44:55.975620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1292/2579] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:44:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:44:57.787206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:44:57.787690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:44:57.788739 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:44:57.813779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] MFA Rules not processed for user `6a75b9c7a5bc4959b27d5c5b87b9c1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:44:57.815233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:44:57.843801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1288/2580] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:44:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:45:05.971158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:07.804914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=11 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:27.891064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:45:27.891756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:45:27.891756 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:45:27.911421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] MFA Rules not processed for user `f9eaebabd54a45a29f262b67fe1c433b`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:45:27.912684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:45:27.991079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1293/2581] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:45:27 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:45:31.284790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:45:31.295993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9493fb-a874-45e2-9d6c-b0c54bd393eb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:45:31.300880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:45:31.301558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:45:31.301845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:45:31.302357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:45:31.304562 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:45:31.326570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:45:31.329983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:45:31.348926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1289/2582] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:45:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:45:33.814042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:45:33.816121 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:45:33.832354 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4491705-8246-4779-96ae-abcb6bc5ae04 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:45:33.839795 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:45:33.840937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:45:33.841262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:45:33.841721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:45:33.844769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:45:33.864955 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:45:33.866534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:45:33.881059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1294/2583] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:45:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:45:41.342997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:45:43.874068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=31 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:03.397660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:03.412684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd771b59-1e56-436c-907f-fe119c6fd484 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:03.419451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:03.420123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:03.420412 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:03.420688 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:03.422817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:03.527053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:03.529464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:03.558257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1290/2584] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:13.554770 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=41 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:31.075482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:31.089816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9becda31-3b38-4811-b39b-c3e6d6a00db4 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:31.105917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:31.106823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:31.107171 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:31.107457 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:31.110546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:31.126153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:31.128715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:31.144470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1295/2585] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:36.968785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:36.978676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493aedf0-d06c-455f-9e53-54d26c5e10b9 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:36.984296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:36.985396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:36.985819 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:36.986356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:36.989241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:37.004293 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:37.005841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:37.017456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1291/2586] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:39.372239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:39.384102 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bc5ed-5519-466b-8183-8953243ab776 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:39.388961 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:39.390006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:39.390593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:39.391044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:39.393152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:39.407044 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:39.408869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:39.435167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1296/2587] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:40.895235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:40.897569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:40.925629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17154cdd-8940-4ef5-a6fb-72e985309431 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:40.945650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:40.948828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:40.948828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:40.948828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] PATH_INFO: `/v3/users/f58d6e222d654e66b38fcefeff65fe80` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:40.951132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58d6e222d654e66b38fcefeff65fe80)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:40.954957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:41.011930 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58d6e222d654e66b38fcefeff65fe80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.020469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58d6e222d654e66b38fcefeff65fe80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.036746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58d6e222d654e66b38fcefeff65fe80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.037786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58d6e222d654e66b38fcefeff65fe80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.047076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cb9758ba-817a-4d2b-bc50-a9f69ea97110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58d6e222d654e66b38fcefeff65fe80'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.059435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1292/2588] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:46:40 2022] DELETE /identity/v3/users/f58d6e222d654e66b38fcefeff65fe80 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:46:41.297849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:41.312235 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fac41f-6f53-4645-863d-6c2bb77010ff service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:41.391556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:41.392468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.392745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.393148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] PATH_INFO: `/v3/projects/dadbbbf08f7b44ce8594f389765f35b2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.394447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dadbbbf08f7b44ce8594f389765f35b2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:41.396577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:41.456766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dadbbbf08f7b44ce8594f389765f35b2', 'request_id': 'req-94945ed6-7cb4-4a6a-917a-104a003d22f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.462644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dadbbbf08f7b44ce8594f389765f35b2', 'request_id': 'req-94945ed6-7cb4-4a6a-917a-104a003d22f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.470182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dadbbbf08f7b44ce8594f389765f35b2', 'request_id': 'req-94945ed6-7cb4-4a6a-917a-104a003d22f5'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.486407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] The token cache is being invalidate because project dadbbbf08f7b44ce8594f389765f35b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:46:41.486695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.487351 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-94945ed6-7cb4-4a6a-917a-104a003d22f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:41.488925 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1297/2589] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:46:41 2022] DELETE /identity/v3/projects/dadbbbf08f7b44ce8594f389765f35b2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:46:41.494288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.494573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.494852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.513870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:46:41.514719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:41.602135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1293/2590] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:46:41.610450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.611038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.611526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.638038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:46:41.640411 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:41.651674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1298/2591] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:46:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:46:41.656265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:41.669927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a6a30d-2e06-48aa-82bc-09ca145d31c8 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:41.675185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:41.675974 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.676878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.676878 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.677415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:46:41.677885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:41.680790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:41.698264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1294/2592] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:46:41.701254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:41.716408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef017e6-7ef6-4104-a697-1bd7ccabfcd2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:41.724584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:41.726930 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.727404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.727845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.728991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:41.732206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:41.801999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1299/2593] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:46:41 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:46:41.804213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:41.835409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5c468-eefb-4445-8ecc-c1f83b6b71a8 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:41.897940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:41.922340 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:41.923808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:41.924849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:41.925518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:41.927487 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:41.931862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:41.984536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1295/2594] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:46:41 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:46:41.989105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:42.003958 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a09b0-510e-4b00-b19c-19adc41c8907 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:42.010327 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:42.011007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:42.011287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:42.011556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:42.012465 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:42.014632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:42.027985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1300/2595] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:46:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:46:42.032281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:42.045914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06f697-bc1e-47d2-a9b1-33b8b562ef53 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:42.051090 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:42.051774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:42.052112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:42.052610 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:42.053833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:42.055569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9793c-8834-4a5c-82c8-08d4f41b68b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:42.072332 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1296/2596] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:46:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:46:42.073954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:42.086226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1112aff-2b74-4ecc-bc51-e814854ea03f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:42.105996 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:42.107318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:42.107601 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:42.107910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] PATH_INFO: `/v3/projects/5c45b12dc0ce4d0a86fcc176c0cf3d67/users/b6173a38d9234fb383c0ba017e459372/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:42.125046 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c45b12dc0ce4d0a86fcc176c0cf3d67, user_id=b6173a38d9234fb383c0ba017e459372, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:42.128902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:42.141832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:42.148182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1301/2597] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:46:42 2022] PUT /identity/v3/projects/5c45b12dc0ce4d0a86fcc176c0cf3d67/users/b6173a38d9234fb383c0ba017e459372/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:46:42.153660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:42.153941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:42.154255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:42.176730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:46:42.178149 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:42.250738 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1297/2598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:46:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:46:42.262132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:42.264579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:42.338445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55449b06-ddd9-4f55-8472-0f0cc275222f admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:42.342280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:42.342978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:42.343283 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:42.343637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:42.354589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:42.356120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de65aa9-0ea0-4531-bb6e-7ba11bd2321d service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:42.367879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1302/2599] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:44.735051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:44.749209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2d338-fb47-4826-abb1-0b9b238039d5 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:44.754831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:44.755537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:44.755871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:44.756147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:44.758225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:44.773578 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:44.774715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:44.794675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1298/2600] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:48.489449 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2b69-2594-43fd-85b0-14c91d74c50d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:48.490017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2b69-2594-43fd-85b0-14c91d74c50d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:48.490274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db2b69-2594-43fd-85b0-14c91d74c50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:48.529033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-62db2b69-2594-43fd-85b0-14c91d74c50d None None] MFA Rules not processed for user `b6173a38d9234fb383c0ba017e459372`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:46:48.530685 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-62db2b69-2594-43fd-85b0-14c91d74c50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:48.636631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1303/2601] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:46:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:46:48.652195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:48.658747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:48.790569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70a41-5608-47f3-bb22-8d7496987122 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:48.798153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:48.798900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:48.799182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:48.799491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:48.815465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:48.818101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:48.832126 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1299/2602] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:46:51.312642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:51.313454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:51.313894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:51.339724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] MFA Rules not processed for user `b6173a38d9234fb383c0ba017e459372`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:46:51.342098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:51.356909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1304/2603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:46:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:46:53.869103 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:53.870640 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:53.943630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:53.945650 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:53.975541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f153cde2-7269-4718-b24b-27b47a24fce8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:53.981744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:53.982874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:53.984079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:53.984804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] PATH_INFO: `/v3/users/c0579a5ba91a4aa89b676598b6d9dfeb` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:53.986512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0579a5ba91a4aa89b676598b6d9dfeb)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:53.988485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:54.009660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:54.049870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101a173-b87e-4181-a3c5-9e61a0061a4f service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:54.057048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:54.057835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:54.058428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:54.058765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:54.061283 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:54.079256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:54.081176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:54.083357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0579a5ba91a4aa89b676598b6d9dfeb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.092831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0579a5ba91a4aa89b676598b6d9dfeb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.093649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0579a5ba91a4aa89b676598b6d9dfeb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.105147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1300/2604] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:46:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:46:54.116468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0579a5ba91a4aa89b676598b6d9dfeb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.117525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0579a5ba91a4aa89b676598b6d9dfeb'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.135574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:54.141474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1305/2605] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:46:53 2022] DELETE /identity/v3/users/c0579a5ba91a4aa89b676598b6d9dfeb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:46:54.370241 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:54.395535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585c7545-008a-4b78-b92d-41959a13fdaa service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:54.461200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:54.462170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:54.462456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:54.462730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] PATH_INFO: `/v3/projects/f07dc511991f4d9f87aa5256f76e402c` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:54.463979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f07dc511991f4d9f87aa5256f76e402c)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:54.465916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:54.519893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f07dc511991f4d9f87aa5256f76e402c', 'request_id': 'req-041337f8-3ab3-4e51-b803-dfc83e7bc794'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.528774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f07dc511991f4d9f87aa5256f76e402c', 'request_id': 'req-041337f8-3ab3-4e51-b803-dfc83e7bc794'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.535674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f07dc511991f4d9f87aa5256f76e402c', 'request_id': 'req-041337f8-3ab3-4e51-b803-dfc83e7bc794'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.546687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] The token cache is being invalidate because project f07dc511991f4d9f87aa5256f76e402c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:46:54.546979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.547736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.552363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1301/2606] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:46:54 2022] DELETE /identity/v3/projects/f07dc511991f4d9f87aa5256f76e402c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:46:54.554136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:54.555831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:54.570412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c19f7-101b-4a0e-8f6c-b42af1d1aa39 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:54.631653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:54.633109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:54.633109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:54.633109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] PATH_INFO: `/v3/users/5a2f77cdf786411faad0acd1da264c2b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:54.634350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a2f77cdf786411faad0acd1da264c2b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:54.636315 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:54.692651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a2f77cdf786411faad0acd1da264c2b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.700562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a2f77cdf786411faad0acd1da264c2b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.701394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a2f77cdf786411faad0acd1da264c2b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.711059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a2f77cdf786411faad0acd1da264c2b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.711824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9b881101-54e9-4fb1-a08c-cc96cbcbdd8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a2f77cdf786411faad0acd1da264c2b'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:54.734819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1306/2607] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:46:54 2022] DELETE /identity/v3/users/5a2f77cdf786411faad0acd1da264c2b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:46:55.009281 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:46:55.012115 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:46:55.067597 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041337f8-3ab3-4e51-b803-dfc83e7bc794 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:46:55.135374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:46:55.143743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:46:55.144840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:46:55.145295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:46:55.145733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] PATH_INFO: `/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:46:55.147324 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fbed8eff2e94258a13b7c6022c3ec64)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:46:55.149325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:46:55.200635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fbed8eff2e94258a13b7c6022c3ec64', 'request_id': 'req-a0599f4a-5b68-4bbc-9772-410ba10d9bea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:55.210517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fbed8eff2e94258a13b7c6022c3ec64', 'request_id': 'req-a0599f4a-5b68-4bbc-9772-410ba10d9bea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:55.223183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fbed8eff2e94258a13b7c6022c3ec64', 'request_id': 'req-a0599f4a-5b68-4bbc-9772-410ba10d9bea'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:55.236172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] The token cache is being invalidate because project 9fbed8eff2e94258a13b7c6022c3ec64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:46:55.236490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:55.237131 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:46:55.239244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1302/2608] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:46:55 2022] DELETE /identity/v3/projects/9fbed8eff2e94258a13b7c6022c3ec64 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:47:04.735475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:05.232296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:06.893766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd4a2-c472-4a16-bb62-d9b404718cc3 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:06.894373 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd4a2-c472-4a16-bb62-d9b404718cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:06.894741 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cebd4a2-c472-4a16-bb62-d9b404718cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:06.915028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6cebd4a2-c472-4a16-bb62-d9b404718cc3 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:47:06.916342 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6cebd4a2-c472-4a16-bb62-d9b404718cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:06.987080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1307/2609] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:47:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:47:07.042216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:07.044080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:07.145433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0599f4a-5b68-4bbc-9772-410ba10d9bea admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:07.151268 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:07.151951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:07.152217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:07.152496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:07.163817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:07.165513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67355bc4-bf90-43b9-9b78-40d224c91b6b service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:07.175457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1303/2610] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:47:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:47:16.976414 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=25 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:17.171849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=32 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:21.559758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:21.559758 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:21.560593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:21.561745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1308/2611] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:47:21.567942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada80fc-09b9-4b1c-bf79-522326f195ec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:21.568839 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada80fc-09b9-4b1c-bf79-522326f195ec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:21.569120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada80fc-09b9-4b1c-bf79-522326f195ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:21.589215 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-dada80fc-09b9-4b1c-bf79-522326f195ec None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:47:21.590672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-dada80fc-09b9-4b1c-bf79-522326f195ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:21.689174 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1304/2612] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:47:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:47:21.701400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:21.703288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:21.780332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e105c-7ed2-4878-95fb-3fe39d764497 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:21.784455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:21.785118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:21.785403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:21.785680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:21.797998 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:21.800108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:21.815830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1309/2613] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:47:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:47:24.613076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:24.613641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:24.613641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:24.633289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:47:24.634558 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:24.643656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1305/2614] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:47:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:47:24.656794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:24.675475 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d92272-f586-435e-9047-44fe6fabb47a service glance] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:24.681288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:24.681970 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:24.682296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:24.682580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:24.692147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:24.693780 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba61dd-bdc8-49ef-be49-5cc472375297 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:24.703367 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1310/2615] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:47:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:47:34.627470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=34 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:34.699760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=32 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:37.038356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:37.039903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:37.111973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf6fe4-e003-4d68-8265-cb35dba1d788 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:37.116547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:37.117313 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:37.117705 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:37.118114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:37.120183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:37.185520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:37.187024 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:37.198197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1306/2616] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:47:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:47:47.192766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=48 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:47:48.401847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:48.402486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:48.402862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:48.444002 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] MFA Rules not processed for user `f9eaebabd54a45a29f262b67fe1c433b`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:47:48.445224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:48.476646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1311/2617] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:47:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:47:49.361782 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:49.364681 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:49.503766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c49fa-7e9b-4225-86ce-dbceb834b083 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:49.509197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:49.509858 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:49.510182 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:49.510462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:49.512356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:49.525284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:49.527030 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9466d1ff-327e-4638-a14d-e6da78d8bb15 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:49.538245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1307/2618] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:47:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:47:50.754579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:50.757407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:50.795544 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cb2bb-251f-4da7-992d-e3a629527210 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:50.806159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:50.806840 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:50.807126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:50.807405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:50.809910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:50.827636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:50.829805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:50.850364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1312/2619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:47:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:47:53.358920 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:53.359733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:53.359733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:53.384702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:47:53.386439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:47:53.396271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1308/2620] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:47:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:47:53.410183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:47:53.422561 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4d195-4155-4fbc-b4c1-cc406df31beb service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:47:53.428454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:47:53.429129 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:47:53.429412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:47:53.429692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:47:53.440214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:47:53.441304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:47:53.450902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1313/2621] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:47:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:48:03.379081 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=57 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:03.447245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=27 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:07.528987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:48:07.530615 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:07.614418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce0f4ea-9cae-4077-847c-00a8cae8c857 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:48:07.619152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:48:07.620057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:48:07.620534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:48:07.622427 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:48:07.622812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:07.698116 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:48:07.699537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cc0e41-b4cf-48df-951e-45bde3ff8e64 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:48:07.710893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1309/2622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:48:07 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:48:09.656037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:48:09.657676 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:09.673691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb29f1-925d-4dc1-bc82-e3f8b396154b service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:48:09.680153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:48:09.680805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:48:09.681084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:48:09.681358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:48:09.683323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:09.697489 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:48:09.699210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:48:09.710403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1314/2623] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:48:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:48:17.705883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=59 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:19.705792 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:48.313563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70619fa-80c5-4c3b-85b1-a90608ab98cb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:48:48.314790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70619fa-80c5-4c3b-85b1-a90608ab98cb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:48:48.314790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70619fa-80c5-4c3b-85b1-a90608ab98cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:48:48.333407 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d70619fa-80c5-4c3b-85b1-a90608ab98cb None None] MFA Rules not processed for user `b6173a38d9234fb383c0ba017e459372`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:48:48.334758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d70619fa-80c5-4c3b-85b1-a90608ab98cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:48.400972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1310/2624] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:48:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:48:48.772542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:48:48.774084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:48.790876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e171f-36dd-4f38-9cb2-917a5a9920c9 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:48:48.795620 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:48:48.796320 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:48:48.796599 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:48:48.796890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:48:48.798953 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:48:48.810595 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:48:48.812054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:48:48.821264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1315/2625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:48:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:48:58.393903 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:48:58.816619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:19.565041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:49:19.565589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:49:19.565589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:49:19.591555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] MFA Rules not processed for user `6a75b9c7a5bc4959b27d5c5b87b9c1cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:49:19.593023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:49:19.653459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1311/2626] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:49:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:49:20.809948 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:49:20.811674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:49:20.851500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c6769e-200f-4289-8533-209e27bcaccf service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:49:20.858221 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:49:20.858606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:49:20.858890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:49:20.859164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:49:20.861276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:49:20.874041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:49:20.875693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:49:20.886455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1316/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:49:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:49:29.646250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=25 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:49:30.881697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=15 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:23.025842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:23.035655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29d874-f94f-4f5d-9c92-1dde73b2e611 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:23.040006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:23.040647 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:23.040921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:23.041188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:23.043011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:23.135140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:23.136603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:23.157450 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1312/2628] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:29.612744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:29.624584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967abd14-7272-41f1-8924-b33c43bff0cd service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:29.631017 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:29.631684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:29.631966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:29.632238 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:29.634480 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:29.647136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:29.648879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:29.661976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1317/2629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:29.673341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:29.675649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:29.695567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25273725-6e96-4012-8578-2e0e8c3166d6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:29.701433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:29.702360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:29.702648 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:29.702923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] PATH_INFO: `/v3/users/f9eaebabd54a45a29f262b67fe1c433b` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:29.704224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9eaebabd54a45a29f262b67fe1c433b)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:29.706352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:29.754204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9eaebabd54a45a29f262b67fe1c433b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:29.762258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9eaebabd54a45a29f262b67fe1c433b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:29.780731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9eaebabd54a45a29f262b67fe1c433b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:29.781577 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9eaebabd54a45a29f262b67fe1c433b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:29.790696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9eaebabd54a45a29f262b67fe1c433b'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:29.797923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1313/2630] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:50:29 2022] DELETE /identity/v3/users/f9eaebabd54a45a29f262b67fe1c433b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:50:29.979393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:29.990453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4183513e-ce8c-4c3c-8120-2e3d47fd96b9 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:30.053418 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:30.054530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:30.054883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:30.055202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] PATH_INFO: `/v3/projects/25adacdcc5b44375b112a93f8623802c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:30.056973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=25adacdcc5b44375b112a93f8623802c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:30.059179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:30.114990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25adacdcc5b44375b112a93f8623802c', 'request_id': 'req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.121824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25adacdcc5b44375b112a93f8623802c', 'request_id': 'req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.129684 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25adacdcc5b44375b112a93f8623802c', 'request_id': 'req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.145422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] The token cache is being invalidate because project 25adacdcc5b44375b112a93f8623802c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:50:30.145709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.146393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.148158 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1318/2631] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:50:29 2022] DELETE /identity/v3/projects/25adacdcc5b44375b112a93f8623802c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:50:30.152269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:30.153808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:30.167677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc38193-3f44-4a96-b991-6266862829d3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:30.206010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:30.234433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:30.234433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:30.234433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:30.234433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] PATH_INFO: `/v3/users/0b87af2c436340c69448d88eba87dc92` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:30.239433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b87af2c436340c69448d88eba87dc92)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:30.241402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:30.296425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b87af2c436340c69448d88eba87dc92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.305715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b87af2c436340c69448d88eba87dc92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.318150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b87af2c436340c69448d88eba87dc92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.318876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b87af2c436340c69448d88eba87dc92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.326612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b87af2c436340c69448d88eba87dc92'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.333296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1314/2632] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:50:30 2022] DELETE /identity/v3/users/0b87af2c436340c69448d88eba87dc92 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:50:30.543424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:30.545080 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:30.558903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0869c7-d685-4385-8a4d-1a30bc2a38ed admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:30.618458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:30.619338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:30.619723 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:30.619917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] PATH_INFO: `/v3/projects/6ed62d92b8514448a97c06f7bb21453b` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:30.621150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed62d92b8514448a97c06f7bb21453b)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:30.623143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:30.645122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:30.678004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed62d92b8514448a97c06f7bb21453b', 'request_id': 'req-467d362a-a38a-4617-8f7e-f77857b8af71'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.684151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed62d92b8514448a97c06f7bb21453b', 'request_id': 'req-467d362a-a38a-4617-8f7e-f77857b8af71'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.691262 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed62d92b8514448a97c06f7bb21453b', 'request_id': 'req-467d362a-a38a-4617-8f7e-f77857b8af71'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.706288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] The token cache is being invalidate because project 6ed62d92b8514448a97c06f7bb21453b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:50:30.706571 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.707224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:50:30.708815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1319/2633] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:50:30 2022] DELETE /identity/v3/projects/6ed62d92b8514448a97c06f7bb21453b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:50:31.605114 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:31.607219 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:31.673793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e0fa6-0f6b-465e-99a3-675dbb57b658 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:31.732711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:31.733433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:31.733795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:31.734157 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:31.742771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:31.773840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:31.846945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:31.848351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39fce7-4370-44d2-a11a-88fa8a4756a1 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:31.874809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1315/2634] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:34.945628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:34.947859 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:35.032817 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d362a-a38a-4617-8f7e-f77857b8af71 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:35.036802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:35.037453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:35.037735 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:35.038007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:35.039927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:35.053665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:35.055153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:35.066198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1320/2635] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:41.872008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=33 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:42.266132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:42.266447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:42.266726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:42.288238 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] MFA Rules not processed for user `b6173a38d9234fb383c0ba017e459372`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:50:42.289987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:42.357821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1316/2636] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:50:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:50:42.698254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:42.700613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:42.717668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b03236-cb75-479d-8377-cd99d2cc1ea4 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:42.724005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:42.724973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:42.725438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:42.725876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:42.728762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:42.739990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:42.741445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67035884-f6ed-4cd5-b191-9f85e7f54ea5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:42.749818 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1321/2637] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:48.661318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:50:48.662972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:48.681459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bd2ad-56c0-42e7-ba54-74c2364c3be4 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:50:48.688658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:50:48.689308 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:50:48.689584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:50:48.689854 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:50:48.691871 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:50:48.764211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:50:48.765821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:50:48.775436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1317/2638] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:50:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:50:52.746407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:50:58.770949 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=53 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:08.538826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d2a-d120-4bf5-89c0-9dc476376c41 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:08.539349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d2a-d120-4bf5-89c0-9dc476376c41 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:08.539450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d2a-d120-4bf5-89c0-9dc476376c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:08.608846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-11323d2a-d120-4bf5-89c0-9dc476376c41 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:08.610137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-11323d2a-d120-4bf5-89c0-9dc476376c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:08.677287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1322/2639] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:51:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:08.730636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:08.732214 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:08.843163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d6ef04-12de-4571-aab5-428efafcd935 service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:08.848720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:08.849374 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:08.849659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:08.849934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:08.859198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:08.860808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c50cf4-e9b8-4b2a-b032-307b10e33a4f service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:08.869638 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1318/2640] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:51:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 10:51:18.674008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=44 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:18.866083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=41 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:22.599016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.599630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.599630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.600965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1323/2641] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:51:22.607668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb087-da4c-40e0-95c7-b7feba7bcb20 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.608538 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb087-da4c-40e0-95c7-b7feba7bcb20 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.608838 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5cb087-da4c-40e0-95c7-b7feba7bcb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.638249 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-5c5cb087-da4c-40e0-95c7-b7feba7bcb20 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:22.639581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5c5cb087-da4c-40e0-95c7-b7feba7bcb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:22.649678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1319/2642] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:22.661976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:22.664056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:22.752679 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba41209-0338-44aa-bd1e-988a590ba49b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:22.756696 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:22.757335 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.757619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.757900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.768101 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:22.769631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5e838-5109-4d6b-b24d-f1685a15a70e service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:22.780675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1324/2643] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:51:22.855595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdb19-a4fb-42f9-bf61-c20e13dde842 None None] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.855909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdb19-a4fb-42f9-bf61-c20e13dde842 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.856188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860fdb19-a4fb-42f9-bf61-c20e13dde842 None None] PATH_INFO: `/` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.857593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1320/2644] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:51:22.862508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007d38-0d13-4285-b330-80e13d13a555 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.862801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007d38-0d13-4285-b330-80e13d13a555 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.863083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007d38-0d13-4285-b330-80e13d13a555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.902020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2f007d38-0d13-4285-b330-80e13d13a555 None None] MFA Rules not processed for user `c697d2c7a55047eaaad9dadab5b8e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:22.903275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2f007d38-0d13-4285-b330-80e13d13a555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:22.909938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1325/2645] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:51:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:22.922091 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdb19-a4fb-42f9-bf61-c20e13dde842 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:22.934690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860fdb19-a4fb-42f9-bf61-c20e13dde842 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:22.938937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:22.939583 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:22.939864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:22.940135 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:22.948376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:22.949864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733f0a7c-986e-44c4-8a56-9f022a4b7afe service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:22.958484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1321/2646] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:51:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:51:23.060200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2622d-fb9e-44f6-9b1b-f32f3c85af34 None None] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:23.060376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2622d-fb9e-44f6-9b1b-f32f3c85af34 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:23.060811 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2622d-fb9e-44f6-9b1b-f32f3c85af34 None None] PATH_INFO: `/` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:23.062984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1326/2647] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jun 21 10:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 21 10:51:23.070095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4ea7-edba-4ca3-bcf4-bdd42519b8f7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:23.070397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4ea7-edba-4ca3-bcf4-bdd42519b8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:23.070668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bde4ea7-edba-4ca3-bcf4-bdd42519b8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:23.092987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3bde4ea7-edba-4ca3-bcf4-bdd42519b8f7 None None] MFA Rules not processed for user `a43c2cee600846c99e25b81e21726370`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:23.094510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3bde4ea7-edba-4ca3-bcf4-bdd42519b8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:23.107175 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1322/2648] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jun 21 10:51:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:23.118285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2622d-fb9e-44f6-9b1b-f32f3c85af34 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:23.131203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2622d-fb9e-44f6-9b1b-f32f3c85af34 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:23.135253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:23.135898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:23.136178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:23.136462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:23.149791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:23.151380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:23.163736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1327/2649] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:51:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:51:24.923397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:24.923873 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:24.923983 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:24.942732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:24.944213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:24.952106 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1323/2650] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:51:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:24.964904 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:24.977118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a88cda-36f6-431c-8c0c-8681cf78a794 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:24.982144 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:24.982727 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:24.983027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:24.983299 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:24.992202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:24.993807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba5925-d0d4-4531-bff2-dc5ff3c7f070 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:25.002126 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1328/2651] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:51:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 21 10:51:34.937223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=19 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:34.998898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=56 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:43.864342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:43.866970 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:43.881351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410837a-adf0-4cbf-b84f-1be34fd3eb5e None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:43.886280 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:43.887290 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:43.888060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:43.888060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:43.889886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:43.900866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:43.902388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:43.910986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1324/2652] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:51:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:51:46.235637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:46.236160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:46.236160 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:46.255957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:51:46.257159 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:51:46.265918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1329/2653] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:51:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:51:46.278501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:51:46.291588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b52aca-0aef-4c44-8de5-6220e887fc4c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:51:46.297130 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:51:46.297778 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:51:46.298071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:51:46.298353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:51:46.306990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:51:46.308669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:51:46.318031 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1325/2654] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:51:56.250594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:51:56.314460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=12 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:12.096815 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:52:12.111901 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef4961-476a-4066-ae88-7af47818acd1 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:52:12.118042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:52:12.118715 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:52:12.119014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:52:12.119293 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:52:12.121360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:52:12.132819 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:52:12.134470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519c9ce9-705c-4cd5-a762-59ddbdd20053 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:52:12.143749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1330/2655] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:52:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:52:22.140025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:26.080728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:52:26.093656 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f273f32-6eb5-4b2b-8e98-d84363ececc9 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:52:26.113547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:52:26.115163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:52:26.115537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:52:26.115817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:52:26.117909 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:52:26.132244 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:52:26.134414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:52:26.147488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1326/2656] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:52:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:52:28.712794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:52:28.713338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:52:28.713338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:52:28.731472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] MFA Rules not processed for user `b6173a38d9234fb383c0ba017e459372`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:52:28.732678 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:52:28.741363 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1331/2657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:52:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:52:36.143397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:38.726157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:52:59.516480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:52:59.527057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e109940-cb2c-4a43-9bd4-7a8966c9f00f service nova] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:52:59.531408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:52:59.532059 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:52:59.532341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:52:59.532614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:52:59.534714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:52:59.601694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:52:59.603167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:52:59.613534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1327/2658] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:52:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:02.805883 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:02.807559 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:02.880365 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:02.882708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:02.891161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2236ea-b9d0-4e1d-8444-d0b93750cf09 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:02.901853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:02.903043 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:02.903334 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:02.903634 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:02.904503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da291b-10a3-451b-86f3-41ca32f7bd05 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:02.905604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:02.909896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:02.910829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:02.911113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:02.911391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] PATH_INFO: `/v3/users/6a75b9c7a5bc4959b27d5c5b87b9c1cd` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:02.912625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a75b9c7a5bc4959b27d5c5b87b9c1cd)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:02.914689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:02.920492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:02.922177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:02.934872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1332/2659] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:02.974463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a75b9c7a5bc4959b27d5c5b87b9c1cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:02.984194 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a75b9c7a5bc4959b27d5c5b87b9c1cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:02.996513 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a75b9c7a5bc4959b27d5c5b87b9c1cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:02.997397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a75b9c7a5bc4959b27d5c5b87b9c1cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.004428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a684d598-0c28-4dbe-a34b-bae2cc46f5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a75b9c7a5bc4959b27d5c5b87b9c1cd'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.010402 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1328/2660] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:02 2022] DELETE /identity/v3/users/6a75b9c7a5bc4959b27d5c5b87b9c1cd => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:03.198979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.214836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6cf2c-22d1-4fed-926f-2923749dbff7 service placement] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.276064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.277016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.277287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.277562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] PATH_INFO: `/v3/projects/136181b906064188b6d06ca200fb9037` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.278805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=136181b906064188b6d06ca200fb9037)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.280760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.331938 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136181b906064188b6d06ca200fb9037', 'request_id': 'req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.337748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136181b906064188b6d06ca200fb9037', 'request_id': 'req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.344866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136181b906064188b6d06ca200fb9037', 'request_id': 'req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.362258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] The token cache is being invalidate because project 136181b906064188b6d06ca200fb9037 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:03.362512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.363215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9ea26c89-4c34-4bc6-96ec-e0198e5130b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:03.364802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1333/2661] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:03 2022] DELETE /identity/v3/projects/136181b906064188b6d06ca200fb9037 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:03.370490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.371190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.371467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.422309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:03.423466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:03.469945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:03.492502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1329/2662] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:03.504691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.504982 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.505258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.525920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:03.527265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:03.535878 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1334/2663] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:03.540449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.551278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f39429-b9a4-4e32-95c8-0850d5216c48 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.556357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.557016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.557327 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.557632 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.558372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:03.558683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.560305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.573134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1330/2664] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:53:03.579244 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.590536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576748-ff76-47c3-a177-ac6dc05afd67 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.596254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.596917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.597210 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.597481 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.598215 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.600161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.611439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:03.645094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1335/2665] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:03 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:53:03.649377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.664260 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc4299e-9468-41b8-a797-2ec213c1f093 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.725737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.726357 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.726643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.726923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.727625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.729971 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.757726 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1331/2666] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:03 2022] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:03.763478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.775108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb431cf-1f4e-4e84-94aa-783112d6454c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.781167 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.781839 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.782161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.782405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.783136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.784766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.795709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1336/2667] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:03.799908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.810779 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012641b-fd6b-4f76-85df-b62b619d0836 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.816049 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.816751 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.817033 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.817311 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.818076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.819713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a404ae7-7378-4d52-aafa-6cba0d349401 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.831799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1332/2668] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:03.836884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:03.851245 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f9288-4efe-4c51-a5b3-5da8c2239ee2 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:03.856306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:03.857243 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.857547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.857824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] PATH_INFO: `/v3/projects/4e62dbe1f2f042e0ad8114a9ab9666c7/users/032842846ef543d29dd90b2dc16a1ac5/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.874020 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e62dbe1f2f042e0ad8114a9ab9666c7, user_id=032842846ef543d29dd90b2dc16a1ac5, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:03.876793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:03.892133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1337/2669] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:03 2022] PUT /identity/v3/projects/4e62dbe1f2f042e0ad8114a9ab9666c7/users/032842846ef543d29dd90b2dc16a1ac5/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:03.903696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:03.904218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:03.904218 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:03.933038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] MFA Rules not processed for user `032842846ef543d29dd90b2dc16a1ac5`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:03.934503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:04.007526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1333/2670] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:03 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:04.018914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:04.020734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:04.083657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a262ab-97f4-4c28-b8b9-aabb219efef5 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:04.087816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:04.088473 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:04.088783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:04.089533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:04.098257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:04.099719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed5842-ff2a-4ff7-ac12-8144f40930a7 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:04.108675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1338/2671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:04 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:12.649462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:12.699066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:12.721350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f36b7b-64ce-429c-bed2-5c1497b8957f None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:12.726101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:12.726979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:12.727254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:12.727528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] PATH_INFO: `/v3/users/032842846ef543d29dd90b2dc16a1ac5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:12.728736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=032842846ef543d29dd90b2dc16a1ac5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:12.730696 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:12.782580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '032842846ef543d29dd90b2dc16a1ac5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:12.792294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '032842846ef543d29dd90b2dc16a1ac5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:12.805401 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '032842846ef543d29dd90b2dc16a1ac5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:12.806096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '032842846ef543d29dd90b2dc16a1ac5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:12.813251 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '032842846ef543d29dd90b2dc16a1ac5'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:12.819107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1334/2672] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:12 2022] DELETE /identity/v3/users/032842846ef543d29dd90b2dc16a1ac5 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:12.824267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:12.824784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:12.824784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:12.845038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:12.846257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:12.910965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1339/2673] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:53:12.920851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:12.922573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:12.984204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee700a-ceba-412a-b9b1-b46bf7ccab43 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:12.989011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:12.989669 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:12.989947 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:12.990258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.000298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.001746 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4856c-0729-49d7-9171-13ada76e2d4c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.011539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1335/2674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:13.295454 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.297260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:13.311898 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd649cd-cfaf-42b8-87e2-f0f2f5b40ef5 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.317111 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.318163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.318447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.318721 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] PATH_INFO: `/v3/projects/4e62dbe1f2f042e0ad8114a9ab9666c7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.320978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e62dbe1f2f042e0ad8114a9ab9666c7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.323079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.368652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:13.371656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e62dbe1f2f042e0ad8114a9ab9666c7', 'request_id': 'req-9f43729a-8e5c-47b5-9a5e-6cac2034277a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:13.378292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e62dbe1f2f042e0ad8114a9ab9666c7', 'request_id': 'req-9f43729a-8e5c-47b5-9a5e-6cac2034277a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:13.384809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e62dbe1f2f042e0ad8114a9ab9666c7', 'request_id': 'req-9f43729a-8e5c-47b5-9a5e-6cac2034277a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:13.398303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] The token cache is being invalidate because project 4e62dbe1f2f042e0ad8114a9ab9666c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:13.398591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:13.399251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f43729a-8e5c-47b5-9a5e-6cac2034277a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:13.400814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1340/2675] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:13 2022] DELETE /identity/v3/projects/4e62dbe1f2f042e0ad8114a9ab9666c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:13.406074 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.406444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.406666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.424788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:13.426085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:13.502204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1336/2676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:53:13.510229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.510503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.510781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.530087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:13.531530 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:13.539542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1341/2677] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:13.543868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.549495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:13.557228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95930eac-3647-4a6c-89e0-2b2a8567c4a7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.563982 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.564652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.564938 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.565209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.566240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:13.566552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.568178 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.581299 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1337/2678] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:53:13.585852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.596028 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3a6ff-5726-4a38-990c-32a6886dfe06 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.604916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.605581 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.605866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.606200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.608785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.610778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.649518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1342/2679] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:13 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:13.655872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.666959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766b7dc4-597b-4832-9b77-947fe6659e4e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.730046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.730792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.731046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.731321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.732044 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.734172 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.758071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1338/2680] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:13 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:13.762157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.773535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9b661-86a3-42dd-8317-2a0c845e6fe0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.778770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.779436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.779747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.780021 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.780965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.782744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.793404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1343/2681] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:13.797823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.808152 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43eb9a15-b2ca-4eab-87fc-fdafdb88ac06 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.813755 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.814433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.814708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.814979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.815703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.817302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9d85f-1203-4ef5-b81c-868f5a34eff7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.831364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1339/2682] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:13.837174 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:13.848490 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179a942-cb3e-4cb2-9598-46d841b7d502 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:13.853502 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:13.854458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.854734 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.855007 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] PATH_INFO: `/v3/projects/7a2888ba143c4a0ab69c1a734b9fb607/users/68ad9278e0ea4d7695bf1328523089c3/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.872598 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2888ba143c4a0ab69c1a734b9fb607, user_id=68ad9278e0ea4d7695bf1328523089c3, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:13.875518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:13.891567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1344/2683] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:13 2022] PUT /identity/v3/projects/7a2888ba143c4a0ab69c1a734b9fb607/users/68ad9278e0ea4d7695bf1328523089c3/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:13.903278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:13.903490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:13.903772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:13.932166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] MFA Rules not processed for user `68ad9278e0ea4d7695bf1328523089c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:13.933397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:14.003855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1340/2684] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:14.008632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.076387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083074-2a47-4386-862c-5613719a6517 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.082747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.083535 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.083915 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.084297 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.085100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.087257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.119694 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1345/2685] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:14 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:14.124580 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.136112 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99836409-4d7f-4399-8f92-45d56896e0d6 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.187866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:14.196180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.196868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.197153 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.197435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.198180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.200128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.222601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1341/2686] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:14 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:14.226812 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.237562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21504c6f-a63c-4074-8bf5-94e319da8dfe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.242637 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.243303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.243586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.243891 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.244627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.246275 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.257349 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1346/2687] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:14.261620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.273382 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d977d5-bee3-4610-a45f-5ac4c4c53164 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.278289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.279141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.279415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.279666 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] PATH_INFO: `/v3/projects/173cd3704a7144cbb2159f3122a3f221/users/8830982d4231454d819712d26b8c2335/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.295551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=173cd3704a7144cbb2159f3122a3f221, user_id=8830982d4231454d819712d26b8c2335, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.298940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.313848 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1342/2688] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:14 2022] PUT /identity/v3/projects/173cd3704a7144cbb2159f3122a3f221/users/8830982d4231454d819712d26b8c2335/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:14.318246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.329435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98626c7d-05d4-4d37-a11a-96f741fbfd89 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.374880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:14.392542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.393212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.393511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.393775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.394577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.396381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aab7bea-2d58-4b43-b804-b2e5bb6ed35b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.407370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1347/2689] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:14 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:53:14.412209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.429367 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5358151-1043-4b74-ad10-4e44c88a18bb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.437438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.438451 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.438671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.438945 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] PATH_INFO: `/v3/projects/173cd3704a7144cbb2159f3122a3f221/users/8830982d4231454d819712d26b8c2335/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.441118 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173cd3704a7144cbb2159f3122a3f221, user_id=8830982d4231454d819712d26b8c2335, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.443802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.455689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1343/2690] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:14 2022] PUT /identity/v3/projects/173cd3704a7144cbb2159f3122a3f221/users/8830982d4231454d819712d26b8c2335/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:14.466384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.466705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.466963 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.494022 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] MFA Rules not processed for user `8830982d4231454d819712d26b8c2335`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:14.495274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:14.569730 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1348/2691] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:14.581805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.583840 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:14.644438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece2122-4342-432e-81f4-6052098740f6 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.648276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.648923 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.649203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.649476 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.659494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.660939 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.673279 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1344/2692] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:14.751344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:14.766699 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2c680-d1d9-4770-a906-6263b5d1a01b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:14.771317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:14.771969 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:14.772253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:14.772526 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:14.849356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:14.850853 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dee47-ed53-4102-8b5d-e1ceaf72b8e8 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:14.860151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1349/2693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:14 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:24.666606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=44,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:24.855946 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=71 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:25.083900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:25.149756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad84cc-1900-4524-b0b9-471260b5f642 service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:25.154771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:25.155729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:25.156008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:25.156388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] PATH_INFO: `/v3/users/68ad9278e0ea4d7695bf1328523089c3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:25.157788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ad9278e0ea4d7695bf1328523089c3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:25.159783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:25.209800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ad9278e0ea4d7695bf1328523089c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.224707 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ad9278e0ea4d7695bf1328523089c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.238940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ad9278e0ea4d7695bf1328523089c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.239737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ad9278e0ea4d7695bf1328523089c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.247683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ad9278e0ea4d7695bf1328523089c3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.254148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1345/2694] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:25 2022] DELETE /identity/v3/users/68ad9278e0ea4d7695bf1328523089c3 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:25.259099 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:25.259386 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:25.259669 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:25.279764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:25.280985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:25.354557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1350/2695] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:25.364720 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:25.366217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:25.428058 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e25206-198b-447a-88f8-1ed98b6fba3c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:25.432349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:25.432992 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:25.433265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:25.433537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:25.445862 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:25.447394 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:25.458085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1346/2696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:25.740337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:25.741813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:25.761630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4e266-9a47-4d5d-95da-72bb0b429f6b None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:25.767438 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:25.768333 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:25.768695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:25.768879 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] PATH_INFO: `/v3/projects/7a2888ba143c4a0ab69c1a734b9fb607` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:25.770206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2888ba143c4a0ab69c1a734b9fb607)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:25.772226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:25.824556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2888ba143c4a0ab69c1a734b9fb607', 'request_id': 'req-9e174036-89bb-4bd7-9de2-19d2e19d0448'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.830304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2888ba143c4a0ab69c1a734b9fb607', 'request_id': 'req-9e174036-89bb-4bd7-9de2-19d2e19d0448'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.836988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2888ba143c4a0ab69c1a734b9fb607', 'request_id': 'req-9e174036-89bb-4bd7-9de2-19d2e19d0448'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.856907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] The token cache is being invalidate because project 7a2888ba143c4a0ab69c1a734b9fb607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:25.857636 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.857941 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:25.859653 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1351/2697] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:25 2022] DELETE /identity/v3/projects/7a2888ba143c4a0ab69c1a734b9fb607 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:25.863928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:25.876614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cabdb73-747d-47f7-801e-c71be48f9f4b service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:25.897429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:25.943132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:25.944002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:25.944278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:25.944547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] PATH_INFO: `/v3/users/8830982d4231454d819712d26b8c2335` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:25.946629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8830982d4231454d819712d26b8c2335)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:25.948569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.000809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8830982d4231454d819712d26b8c2335'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.009423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8830982d4231454d819712d26b8c2335'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.022362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8830982d4231454d819712d26b8c2335'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.023101 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8830982d4231454d819712d26b8c2335'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.030673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-5aeaf416-51f5-4d43-957a-d6a131b8885a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8830982d4231454d819712d26b8c2335'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.036877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1347/2698] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:25 2022] DELETE /identity/v3/users/8830982d4231454d819712d26b8c2335 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:26.357779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.359534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:26.374031 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e174036-89bb-4bd7-9de2-19d2e19d0448 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.433511 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.434422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.434705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.434979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] PATH_INFO: `/v3/projects/173cd3704a7144cbb2159f3122a3f221` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.436178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] RBAC: Authorizing `identity:delete_project(project_id=173cd3704a7144cbb2159f3122a3f221)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.438150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.470025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:26.489322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173cd3704a7144cbb2159f3122a3f221', 'request_id': 'req-61cb08ce-48e5-4f70-a881-82cbe4da298d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.496474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173cd3704a7144cbb2159f3122a3f221', 'request_id': 'req-61cb08ce-48e5-4f70-a881-82cbe4da298d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.503688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173cd3704a7144cbb2159f3122a3f221', 'request_id': 'req-61cb08ce-48e5-4f70-a881-82cbe4da298d'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.522042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] The token cache is being invalidate because project 173cd3704a7144cbb2159f3122a3f221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:26.522364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.523154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-61cb08ce-48e5-4f70-a881-82cbe4da298d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:26.525277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1352/2699] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:26 2022] DELETE /identity/v3/projects/173cd3704a7144cbb2159f3122a3f221 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:26.531252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.531552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.531823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.551489 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:26.552810 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:26.615247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1348/2700] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:26.624865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.625155 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.625433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.645013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:26.646303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:26.655635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1353/2701] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:26.660096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.670954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83267505-a22c-4b66-ae9f-6abfe8737090 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.676050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.676718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.677000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.677274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.678038 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:26.678387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.680000 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.692937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1349/2702] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:53:26.700113 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.713709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd09223-b6b2-4a32-afc4-1c63756b6e26 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.719487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.720145 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.720425 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.720697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.721381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.723360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.757506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1354/2703] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:26 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:26.764111 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.775774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821c0b1-7a0b-4d94-8c70-dfa40705791b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.802431 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:26.845066 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.845745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.846032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.846336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.847029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.848976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.869568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1350/2704] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:26 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:26.873803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.884555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4f875-b49e-4f80-92f8-c9ac49d23be0 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.890536 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.891183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.891467 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.891738 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.892470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.894131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.905417 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1355/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:26.909658 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.920595 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a6104-6797-432e-9052-653433c1f671 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.926598 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.927262 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.927547 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.927842 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.928576 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.930413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee8aa67-406c-4d92-977a-479ce0cc2b4f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.940966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1351/2706] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:26.945508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:26.956421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9bed1a-4eaf-46d4-b146-1e414a7050d4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:26.961767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:26.962906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:26.963192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:26.963487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] PATH_INFO: `/v3/projects/0f01b457acf0443ba13c82d6b4df34d7/users/822b6b82aafd43adbde8249583156a69/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:26.979468 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f01b457acf0443ba13c82d6b4df34d7, user_id=822b6b82aafd43adbde8249583156a69, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:26.982195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:26.996877 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1356/2707] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:26 2022] PUT /identity/v3/projects/0f01b457acf0443ba13c82d6b4df34d7/users/822b6b82aafd43adbde8249583156a69/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:27.007371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.007665 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.007943 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.036228 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] MFA Rules not processed for user `822b6b82aafd43adbde8249583156a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:27.037377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:27.119916 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1352/2708] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 21 10:53:27.124654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.198635 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad561fd-958e-4f64-bc06-116d1790735e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.203777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.204446 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.204726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.205008 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.205695 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.207662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.236773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1357/2709] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:27 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:27.240965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.253353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0073f3-7b2c-49d0-803b-b2dff5438929 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.324250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.324925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.325211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.325488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.326225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.328163 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.353546 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1353/2710] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:27 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:53:27.355427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.370781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512e5c1-58ed-4c46-986a-b347a9e8ab30 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.376506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.377239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.377521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.377794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.378567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.380194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.391630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1358/2711] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:27.395851 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.406608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9477-8d64-49ba-9b33-48e57307c579 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.412161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.413060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.413343 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.413626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] PATH_INFO: `/v3/projects/66011434b0a34fd8b27164ea73af5dc5/users/36b9b6e7f7944ab9bf7b3e732e724843/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.430097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66011434b0a34fd8b27164ea73af5dc5, user_id=36b9b6e7f7944ab9bf7b3e732e724843, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.433035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.450246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1354/2712] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:27 2022] PUT /identity/v3/projects/66011434b0a34fd8b27164ea73af5dc5/users/36b9b6e7f7944ab9bf7b3e732e724843/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:53:27.454894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.466487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7f1c5-a1bd-497b-a7cf-c3d0b0484032 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.487837 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:27.528312 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.529016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.529303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.529580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.530338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.531966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312a296-89a4-4bb3-8eda-56dcc44bdbc4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.544783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1359/2713] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:27.550824 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.558400 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:27.566339 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821f7ba-ddfb-433a-85b3-ba5b24d8f9b5 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.573719 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.575171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.575392 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.575667 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] PATH_INFO: `/v3/projects/66011434b0a34fd8b27164ea73af5dc5/users/36b9b6e7f7944ab9bf7b3e732e724843/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.577877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=66011434b0a34fd8b27164ea73af5dc5, user_id=36b9b6e7f7944ab9bf7b3e732e724843, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.580808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.592806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1355/2714] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:27 2022] PUT /identity/v3/projects/66011434b0a34fd8b27164ea73af5dc5/users/36b9b6e7f7944ab9bf7b3e732e724843/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:27.607213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.607546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.607823 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.636543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] MFA Rules not processed for user `36b9b6e7f7944ab9bf7b3e732e724843`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:27.637768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:27.714852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1360/2715] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:27.729966 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:27.731794 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:27.793567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8881e5-16d3-4893-916b-40e434f24ebd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:27.797709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:27.798388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:27.798675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:27.798950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:27.808926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:27.810406 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed14a42-68a8-4860-a8d7-a571730e90c5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:27.820397 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1356/2716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:29.258509 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:29.329420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6702722-d5c3-4369-9af7-3b09b724fd94 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:29.334533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:29.335413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:29.335697 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:29.335973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] PATH_INFO: `/v3/users/822b6b82aafd43adbde8249583156a69` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:29.337294 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=822b6b82aafd43adbde8249583156a69)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:29.339280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:29.389933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '822b6b82aafd43adbde8249583156a69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:29.391109 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:29.400197 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '822b6b82aafd43adbde8249583156a69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:29.400919 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '822b6b82aafd43adbde8249583156a69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:29.409923 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '822b6b82aafd43adbde8249583156a69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:29.410814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '822b6b82aafd43adbde8249583156a69'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:29.431147 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1361/2717] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:29 2022] DELETE /identity/v3/users/822b6b82aafd43adbde8249583156a69 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:29.435975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:29.436467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:29.436589 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:29.455306 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:29.456625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:29.529866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1357/2718] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:29.539976 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:29.541573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:29.603997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf5aa5c-0150-4927-8c40-b7a1c36557a4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:29.608003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:29.608658 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:29.608972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:29.609246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:29.619082 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:29.620545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:29.630380 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1362/2719] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:29.925171 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:29.926802 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:29.941312 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fef66-6664-4755-9e11-52e7ecddcc4a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:29.946483 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:29.947369 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:29.947649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:29.947928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] PATH_INFO: `/v3/projects/0f01b457acf0443ba13c82d6b4df34d7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:29.949827 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f01b457acf0443ba13c82d6b4df34d7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:29.951869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:30.003731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f01b457acf0443ba13c82d6b4df34d7', 'request_id': 'req-f9491b27-6d52-4a5f-b699-8c63234b6d13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.012309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f01b457acf0443ba13c82d6b4df34d7', 'request_id': 'req-f9491b27-6d52-4a5f-b699-8c63234b6d13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.019102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f01b457acf0443ba13c82d6b4df34d7', 'request_id': 'req-f9491b27-6d52-4a5f-b699-8c63234b6d13'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.030325 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] The token cache is being invalidate because project 0f01b457acf0443ba13c82d6b4df34d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:30.030612 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.031405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.033096 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1358/2720] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:29 2022] DELETE /identity/v3/projects/0f01b457acf0443ba13c82d6b4df34d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:30.037412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:30.047994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f06e2a3-03f8-4e30-b190-cd951ac8a755 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:30.108977 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:30.109886 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.110201 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.110482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] PATH_INFO: `/v3/users/36b9b6e7f7944ab9bf7b3e732e724843` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.111781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b9b6e7f7944ab9bf7b3e732e724843)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:30.113860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:30.167858 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b9b6e7f7944ab9bf7b3e732e724843'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.174503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b9b6e7f7944ab9bf7b3e732e724843'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.175168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b9b6e7f7944ab9bf7b3e732e724843'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.183863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b9b6e7f7944ab9bf7b3e732e724843'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.184478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cb6d04c1-150e-4fd1-ba79-0267bad3df71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b9b6e7f7944ab9bf7b3e732e724843'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.190229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:30.205023 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1363/2721] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:30 2022] DELETE /identity/v3/users/36b9b6e7f7944ab9bf7b3e732e724843 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:30.507668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:30.510743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:30.530661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9491b27-6d52-4a5f-b699-8c63234b6d13 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:30.546415 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:30.596914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:30.597845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.598195 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.598469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] PATH_INFO: `/v3/projects/66011434b0a34fd8b27164ea73af5dc5` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.599702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66011434b0a34fd8b27164ea73af5dc5)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:30.601790 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:30.651471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66011434b0a34fd8b27164ea73af5dc5', 'request_id': 'req-533be9ed-ab66-4b13-9ceb-9d673af55346'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.658900 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66011434b0a34fd8b27164ea73af5dc5', 'request_id': 'req-533be9ed-ab66-4b13-9ceb-9d673af55346'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.665689 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66011434b0a34fd8b27164ea73af5dc5', 'request_id': 'req-533be9ed-ab66-4b13-9ceb-9d673af55346'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.677143 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] The token cache is being invalidate because project 66011434b0a34fd8b27164ea73af5dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:30.677362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.678110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-533be9ed-ab66-4b13-9ceb-9d673af55346 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:30.679826 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1359/2722] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:30 2022] DELETE /identity/v3/projects/66011434b0a34fd8b27164ea73af5dc5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:30.685384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.685895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.686077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.704482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:30.705691 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:30.769146 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1364/2723] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:30.777075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.777364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.777663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.797418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:30.798676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:30.810730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1360/2724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:30.815564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:30.827350 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca925a4-248c-4031-a442-aa54443b3489 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:30.834104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:30.834770 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.835052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.835311 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.836041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:30.836337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:30.838266 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:30.852005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1365/2725] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:53:30.857484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:30.868042 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce1ca0-8d61-482e-b0e4-fb2cc864b713 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:30.873926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:30.874710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.874978 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.875276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.875973 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:30.878462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:30.912456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1361/2726] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:30 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:30.917724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:30.927896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed568-1a1a-40cc-b831-123d0c0dd9e9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:30.987771 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:30.988428 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:30.988703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:30.988985 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:30.989688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:30.991665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.013154 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1366/2727] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:30 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:31.017467 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.028087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421abd1-2f07-45bd-9264-d5c59e52c5de admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.033041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.033708 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.033990 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.034294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.035022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.036637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.047520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1362/2728] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:31.051488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.062760 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d614f9-28f6-42f7-b742-897b5ae573e1 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.068368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.069032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.069302 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.069573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.070709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.072497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0631557-8a42-4f6b-b54a-3b4665edc3dd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.083317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1367/2729] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:31.087942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.098906 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8e0a-c64f-4e89-8e97-9892cf1927f4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.104189 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.105083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.105344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.105622 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] PATH_INFO: `/v3/projects/6dbcb81d96ae4f0e9e1429d2fa507fe8/users/db0c53882cba40c1a562b3b3c5d91052/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.122885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dbcb81d96ae4f0e9e1429d2fa507fe8, user_id=db0c53882cba40c1a562b3b3c5d91052, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.125555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.142379 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1363/2730] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:31 2022] PUT /identity/v3/projects/6dbcb81d96ae4f0e9e1429d2fa507fe8/users/db0c53882cba40c1a562b3b3c5d91052/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:53:31.155524 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.155825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.156188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.185036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] MFA Rules not processed for user `db0c53882cba40c1a562b3b3c5d91052`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:31.186202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:31.233719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:31.262829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1368/2731] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:31.267454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.313775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:31.332984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6bc17e-c960-4761-803a-32219219188f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.338426 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.339089 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.339371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.339643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.340338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.342282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.376250 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1364/2732] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:31 2022] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:31.382084 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.393329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc62c6-143e-463b-b879-850d869df430 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.450413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.450884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.451172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.451442 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.452152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.454135 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.475934 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1369/2733] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:31 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:53:31.480575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.491890 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e12d39-37cd-4570-a40c-44a4e338a021 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.497256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.497929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.498246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.498527 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.499267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.501022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.512574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1365/2734] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:31.517118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.528198 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952895e-0e23-4a10-b670-40f7ad36d23d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.534538 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.535440 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.535722 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.536012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] PATH_INFO: `/v3/projects/2b6c47016571478bbceb601016b12042/users/6ac938aea6a347d182b108191f452353/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.551459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6c47016571478bbceb601016b12042, user_id=6ac938aea6a347d182b108191f452353, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.554181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.569183 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1370/2735] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:31 2022] PUT /identity/v3/projects/2b6c47016571478bbceb601016b12042/users/6ac938aea6a347d182b108191f452353/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:31.574548 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.585620 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3dc150-e50c-41de-9700-bed1d1fdf112 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.655731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.656537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.656786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.657085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.657985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.660201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fffe51-a255-497d-81b1-2302ccc00e02 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.673125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1366/2736] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:31 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:31.677613 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.688477 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c43784-c555-4e29-9849-3257032a3c87 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.693314 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.694278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.694560 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.695187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] PATH_INFO: `/v3/projects/2b6c47016571478bbceb601016b12042/users/6ac938aea6a347d182b108191f452353/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.697366 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b6c47016571478bbceb601016b12042, user_id=6ac938aea6a347d182b108191f452353, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.700067 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.710432 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1371/2737] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:31 2022] PUT /identity/v3/projects/2b6c47016571478bbceb601016b12042/users/6ac938aea6a347d182b108191f452353/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:53:31.772855 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.773145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.773423 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.803039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] MFA Rules not processed for user `6ac938aea6a347d182b108191f452353`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:31.804257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:31.877931 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1367/2738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:31.890203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:31.892825 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:31.965313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9c9de0-f585-4973-b7d1-20ea1c4912f4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:31.969406 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:31.970078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:31.970374 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:31.970660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:31.980356 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:31.981822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:31.991479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1372/2739] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:32.039942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:32.041434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:32.055950 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794db3b2-911a-439d-82f6-a24d6997e927 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:32.059907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:32.060560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:32.060844 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:32.061123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:32.095672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:32.121270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:32.122764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f9be51-f801-4e62-b0ba-d8ba2eefb1fe service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:32.131776 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1368/2740] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:35.570416 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:35.623029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:35.647663 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8f2c7-e4fb-4164-83fc-549d162993f3 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:35.653265 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:35.654157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:35.654462 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:35.654737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] PATH_INFO: `/v3/users/db0c53882cba40c1a562b3b3c5d91052` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:35.656011 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0c53882cba40c1a562b3b3c5d91052)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:35.657992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:35.718555 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0c53882cba40c1a562b3b3c5d91052'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:35.725880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0c53882cba40c1a562b3b3c5d91052'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:35.733585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0c53882cba40c1a562b3b3c5d91052'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:35.743216 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0c53882cba40c1a562b3b3c5d91052'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:35.743973 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0c53882cba40c1a562b3b3c5d91052'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:35.763733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1373/2741] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:35 2022] DELETE /identity/v3/users/db0c53882cba40c1a562b3b3c5d91052 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:35.768440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:35.768953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:35.769055 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:35.787257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:35.788462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:35.849921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1369/2742] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:35.860448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:35.862651 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:35.930258 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdcf419-b1d4-4620-962d-86bf7532dc50 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:35.935090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:35.935754 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:35.936036 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:35.936329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:35.950779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:35.952657 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:35.963564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1374/2743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:36.280893 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:36.282575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:36.295302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf6608-2be6-4ba3-be90-a980a3824eec None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:36.300702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:36.301584 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:36.301870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:36.302173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] PATH_INFO: `/v3/projects/6dbcb81d96ae4f0e9e1429d2fa507fe8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:36.303514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dbcb81d96ae4f0e9e1429d2fa507fe8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:36.305471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:36.356760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dbcb81d96ae4f0e9e1429d2fa507fe8', 'request_id': 'req-9e64df96-b9ce-47a1-866a-ea7447c255e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.365448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dbcb81d96ae4f0e9e1429d2fa507fe8', 'request_id': 'req-9e64df96-b9ce-47a1-866a-ea7447c255e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.372150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dbcb81d96ae4f0e9e1429d2fa507fe8', 'request_id': 'req-9e64df96-b9ce-47a1-866a-ea7447c255e2'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.383088 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] The token cache is being invalidate because project 6dbcb81d96ae4f0e9e1429d2fa507fe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:36.383399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.384142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.385771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1370/2744] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:36 2022] DELETE /identity/v3/projects/6dbcb81d96ae4f0e9e1429d2fa507fe8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:36.389845 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:36.400633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa460f2-0287-444e-b634-1a8f478ed216 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:36.463217 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:36.464096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:36.464375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:36.464644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] PATH_INFO: `/v3/users/6ac938aea6a347d182b108191f452353` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:36.465848 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac938aea6a347d182b108191f452353)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:36.467937 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:36.469557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:36.520190 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac938aea6a347d182b108191f452353'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.528156 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac938aea6a347d182b108191f452353'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.529086 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac938aea6a347d182b108191f452353'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.538226 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac938aea6a347d182b108191f452353'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.538865 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-2ac90d0f-a024-4895-b531-5f20113f5bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac938aea6a347d182b108191f452353'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:36.556905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1375/2745] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:36 2022] DELETE /identity/v3/users/6ac938aea6a347d182b108191f452353 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:36.870540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:36.872203 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:36.889908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64df96-b9ce-47a1-866a-ea7447c255e2 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:36.952953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:36.953825 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:36.954102 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:36.954396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] PATH_INFO: `/v3/projects/2b6c47016571478bbceb601016b12042` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:36.955711 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b6c47016571478bbceb601016b12042)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:36.957660 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:36.959345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:37.018371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b6c47016571478bbceb601016b12042', 'request_id': 'req-cd7069a0-ec69-4bc4-8100-eec177959cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:37.032627 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b6c47016571478bbceb601016b12042', 'request_id': 'req-cd7069a0-ec69-4bc4-8100-eec177959cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:37.039699 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b6c47016571478bbceb601016b12042', 'request_id': 'req-cd7069a0-ec69-4bc4-8100-eec177959cd9'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:37.050718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] The token cache is being invalidate because project 2b6c47016571478bbceb601016b12042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:37.051192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:37.052196 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-cd7069a0-ec69-4bc4-8100-eec177959cd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:37.053870 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1371/2746] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:36 2022] DELETE /identity/v3/projects/2b6c47016571478bbceb601016b12042 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:37.059821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.060421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.060421 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.082470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:37.083690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:37.156255 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1376/2747] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:37.167760 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.168062 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.168399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.192526 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:37.193748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:37.204275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1372/2748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:37.208664 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.219466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7859-5461-43f1-b114-33c03ac58fe9 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.224726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.225378 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.225764 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.225929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.226689 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:37.226983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.229228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.242478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1377/2749] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:53:37.248725 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.261147 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c61a7-b778-4ca8-b050-44120f976fd7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.266085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.266860 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.267141 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.267414 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.268110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.270040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.298144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1373/2750] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:37.302368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.312884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b03c7e3-38ab-4477-b6dc-11c5e17361c6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.379703 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.380784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.381194 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.381593 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.382821 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.385787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.401068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:37.417681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1378/2751] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:37.421773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.432957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87123bc-f1a9-4fb0-b46c-35df9f9095c9 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.437727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.438446 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.438730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.439008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.439742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.441355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.452936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1374/2752] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:37.457322 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.471273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b645a6f8-e8ea-40d6-8776-da0fcad167d9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.478768 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.479478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.479761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.480039 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.480774 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.482441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4e83bb-dc8e-4109-89ec-7b4d40c6c045 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.493018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1379/2753] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:37.497883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.511937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04150cc-1118-4289-b8cc-f34a75a7be07 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.516940 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.517835 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.518154 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.518433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] PATH_INFO: `/v3/projects/49f5afc4f2664ce19f7102e97611277c/users/959886165185474fa50a41f5354e765a/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.533911 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=49f5afc4f2664ce19f7102e97611277c, user_id=959886165185474fa50a41f5354e765a, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.536649 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.550866 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1375/2754] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:37 2022] PUT /identity/v3/projects/49f5afc4f2664ce19f7102e97611277c/users/959886165185474fa50a41f5354e765a/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:37.561323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.561609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.561869 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.591137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] MFA Rules not processed for user `959886165185474fa50a41f5354e765a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:37.592371 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:37.662743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1380/2755] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:37.667435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.735622 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052a318-e6d1-4c36-9329-169339b144eb admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.740807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.741465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.741748 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.742022 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.742768 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.745005 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.773613 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1376/2756] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:53:37.778914 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.795833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e2362-ce0e-4f8b-a6af-05d264fe3d4c None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.872105 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.872804 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.872918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.873165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.873881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.875847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.898749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1381/2757] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:37 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:37.905052 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.921211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9793bb-e60d-4f85-a143-50f99d37fd61 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.929761 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.930955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.931443 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.931793 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.932556 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.934190 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:37.939786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:37.946754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1377/2758] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:37.951273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:37.961660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d18870-374c-4fc5-9bcf-f2a7a9303e82 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:37.966943 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:37.967838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:37.968110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:37.968379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] PATH_INFO: `/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32/users/92609185125a4f7f9cc65196f1a14424/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:37.984748 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eac5a076b24900a99c4ac8db7c4e32, user_id=92609185125a4f7f9cc65196f1a14424, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:37.987537 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.002010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1382/2759] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:37 2022] PUT /identity/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32/users/92609185125a4f7f9cc65196f1a14424/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:38.006161 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:38.016363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534f3791-186d-493a-9c3a-1451e63c8c0e admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:38.075549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:38.076252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.076518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.076792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.077519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:38.079173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20fb38-4828-4fd5-b820-74c41a31bb53 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.090257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1378/2760] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:38.096396 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:38.107654 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42faa26-6915-4455-b074-f6d1026a1ce9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:38.112876 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:38.113781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.114103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.114424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] PATH_INFO: `/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32/users/92609185125a4f7f9cc65196f1a14424/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.116785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0eac5a076b24900a99c4ac8db7c4e32, user_id=92609185125a4f7f9cc65196f1a14424, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:38.119790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.130464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1383/2761] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:38 2022] PUT /identity/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32/users/92609185125a4f7f9cc65196f1a14424/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:38.142269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.143275 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.143554 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.176050 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] MFA Rules not processed for user `92609185125a4f7f9cc65196f1a14424`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:38.177272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:38.249579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1379/2762] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:38.261945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:38.263857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:38.296984 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:38.327006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f551e95-0855-4931-8426-aeffcef9fdf6 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:38.330852 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:38.331506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.331784 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.332057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.341338 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:38.342832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3324111-605c-40d6-bab5-b65f716573c5 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.352254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1384/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:38.424625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:38.498454 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de97bab-8c2f-4126-8999-b61fffe91fa7 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:38.503570 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:38.504364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.504641 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.504917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] PATH_INFO: `/v3/users/959886165185474fa50a41f5354e765a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.506236 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=959886165185474fa50a41f5354e765a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:38.508170 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.531355 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:38.560606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '959886165185474fa50a41f5354e765a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:38.568976 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '959886165185474fa50a41f5354e765a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:38.583375 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '959886165185474fa50a41f5354e765a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:38.584023 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '959886165185474fa50a41f5354e765a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:38.593917 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '959886165185474fa50a41f5354e765a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:38.603619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1380/2764] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:38 2022] DELETE /identity/v3/users/959886165185474fa50a41f5354e765a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:38.610441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.610793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.611177 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.632459 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:38.633674 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:38.698310 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1385/2765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:38.708097 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:38.709619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:38.780020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c85605-adbf-42d7-b0cd-136b2a6b13dc admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:38.784560 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:38.785232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:38.785514 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:38.785783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:38.796876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:38.798354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:38.808773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1381/2766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:39.108927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:39.110629 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:39.131518 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace7ebb-7aae-40aa-b781-bee1fb037821 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:39.137162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:39.138038 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:39.138344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:39.138619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] PATH_INFO: `/v3/projects/49f5afc4f2664ce19f7102e97611277c` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:39.139842 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=49f5afc4f2664ce19f7102e97611277c)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:39.141761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:39.190306 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49f5afc4f2664ce19f7102e97611277c', 'request_id': 'req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.196108 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49f5afc4f2664ce19f7102e97611277c', 'request_id': 'req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.202957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49f5afc4f2664ce19f7102e97611277c', 'request_id': 'req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.224435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] The token cache is being invalidate because project 49f5afc4f2664ce19f7102e97611277c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:39.224690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.225466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.227164 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1386/2767] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:39 2022] DELETE /identity/v3/projects/49f5afc4f2664ce19f7102e97611277c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:39.232344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:39.243551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8064b645-5c23-46ec-aa34-312c5d1393c9 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:39.303792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:39.304599 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:39.304880 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:39.305173 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] PATH_INFO: `/v3/users/92609185125a4f7f9cc65196f1a14424` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:39.306396 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92609185125a4f7f9cc65196f1a14424)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:39.308359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:39.361517 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:39.365603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92609185125a4f7f9cc65196f1a14424'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.377416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92609185125a4f7f9cc65196f1a14424'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.391351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92609185125a4f7f9cc65196f1a14424'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.392113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92609185125a4f7f9cc65196f1a14424'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.399498 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-f5d538dd-704a-44f0-9f23-35894a582706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92609185125a4f7f9cc65196f1a14424'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.406418 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1382/2768] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:39 2022] DELETE /identity/v3/users/92609185125a4f7f9cc65196f1a14424 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:39.702400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:39.703967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:39.717802 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb79a7-15c0-4fa8-bcd9-b77cf21fb9ef admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:39.768573 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:39.779589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:39.780487 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:39.780767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:39.781059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] PATH_INFO: `/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:39.782273 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0eac5a076b24900a99c4ac8db7c4e32)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:39.784230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:39.834563 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0eac5a076b24900a99c4ac8db7c4e32', 'request_id': 'req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.840614 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0eac5a076b24900a99c4ac8db7c4e32', 'request_id': 'req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.847092 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0eac5a076b24900a99c4ac8db7c4e32', 'request_id': 'req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.862163 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] The token cache is being invalidate because project f0eac5a076b24900a99c4ac8db7c4e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:39.862394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.863042 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-77d48a71-c6d8-4e63-b675-af46bbbcc2f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:39.864647 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1387/2769] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:39 2022] DELETE /identity/v3/projects/f0eac5a076b24900a99c4ac8db7c4e32 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:39.870076 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:39.870411 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:39.870697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:39.888697 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:39.889913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:39.953160 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1383/2770] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:39.961151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:39.961439 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:39.961708 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:39.981619 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:39.982863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:39.991775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1388/2771] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:39.997425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.012965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707d81-cd76-4a6c-ab81-8162b60d90fa None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.020736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.021631 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.021996 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.022403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.023501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:53:40.023849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.026273 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.039300 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1384/2772] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:53:40.045010 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.055182 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c413e7d6-d7ff-4d62-8dc8-f8d1b3a2491d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.061757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.062448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.062733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.063004 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.063693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.065667 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.100037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1389/2773] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:40.104449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.117139 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8d3a3f-74ae-4433-b7a4-e2c08b9b0c9a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.185460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.186217 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.186500 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.186777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.187484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.189425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.212425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1385/2774] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/users => generated 293 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:40.217504 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.231130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d5c40-8850-4c2f-b67b-b7fe77a2197c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.239451 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.240402 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.240766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.241119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.242209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.244427 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.257077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1390/2775] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:53:40.261255 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.272440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73015fcf-b485-4ad0-b167-ef51b3e63bdf admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.277321 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.278014 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.278390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.278743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.279480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.281099 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2524c3-e2ba-43de-9475-3bf91a9f775d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.292008 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1386/2776] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:40.297259 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.307422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e7498-b753-4087-91b7-d56f9bd93237 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.312365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.313251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.313534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.313809 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] PATH_INFO: `/v3/projects/6c2a9bb5f31746f8b1a8de944bfcb0f0/users/44bff490dcdc444fa927dd7516c92bce/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.329420 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2a9bb5f31746f8b1a8de944bfcb0f0, user_id=44bff490dcdc444fa927dd7516c92bce, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.332225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.350801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1391/2777] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:40 2022] PUT /identity/v3/projects/6c2a9bb5f31746f8b1a8de944bfcb0f0/users/44bff490dcdc444fa927dd7516c92bce/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:53:40.366845 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.367733 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.368167 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.399655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] MFA Rules not processed for user `44bff490dcdc444fa927dd7516c92bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:40.400908 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:40.420358 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:40.482993 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1387/2778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:40.489750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.577705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286c6726-ee59-4dae-bf93-57158f0c3926 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.584152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.584829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.585110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.585387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.586173 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.588142 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.616900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1392/2779] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:40.621156 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.632581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753651ce-3a12-4a60-a409-50137fe8544a None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.694333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.695372 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.695654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.695926 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.696616 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.698634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.721684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1388/2780] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:53:40.725911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.733341 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:40.738534 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad632230-2bea-414e-bd78-6e6739db646b admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.746282 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.747298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.747591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.748057 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.748808 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.750857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.763441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1393/2781] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:53:40.769644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.783151 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ed4a8a-3628-43d3-9e31-d8974c756859 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.788047 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.788942 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.789226 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.789529 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] PATH_INFO: `/v3/projects/4c94a16b82c74fc1a4be3478f1266da2/users/55382fc5a34c496ca2d8c0a66179ee93/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.804977 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c94a16b82c74fc1a4be3478f1266da2, user_id=55382fc5a34c496ca2d8c0a66179ee93, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.807678 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.823333 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1389/2782] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:40 2022] PUT /identity/v3/projects/4c94a16b82c74fc1a4be3478f1266da2/users/55382fc5a34c496ca2d8c0a66179ee93/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:40.828579 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.839484 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65d2265-9ba8-452b-8c37-741b7cce49f8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.899220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.899791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.900075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.900348 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.901090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.902851 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8713688a-e52b-48d5-b9f0-d63452f7d732 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.912855 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1394/2783] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:53:40.919284 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:40.935286 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17585d37-570f-4f59-85cf-1c4ca8cf0086 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:40.941245 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:40.942224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.942499 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.942774 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] PATH_INFO: `/v3/projects/4c94a16b82c74fc1a4be3478f1266da2/users/55382fc5a34c496ca2d8c0a66179ee93/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:40.945368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c94a16b82c74fc1a4be3478f1266da2, user_id=55382fc5a34c496ca2d8c0a66179ee93, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:40.948137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:40.959964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1390/2784] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:53:40 2022] PUT /identity/v3/projects/4c94a16b82c74fc1a4be3478f1266da2/users/55382fc5a34c496ca2d8c0a66179ee93/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:40.971954 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:40.972279 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:40.972546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:41.001212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] MFA Rules not processed for user `55382fc5a34c496ca2d8c0a66179ee93`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:41.002448 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:41.076908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1395/2785] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:41.090474 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:41.093561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:41.155928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccee5c3-b222-4575-b1c8-557a20c74dde admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:41.159579 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:41.160224 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:41.160501 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:41.160773 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:41.188815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:41.223856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:41.225317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:41.235441 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1391/2786] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:45.580176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:45.581909 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:45.598295 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1949c3-08b9-4721-bc4f-40eae23614ca None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:45.603706 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:45.604704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:45.605195 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:45.606435 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:45.615868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:45.617370 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f59a-7f81-4b1b-aee7-aa24659837a5 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:45.628705 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1396/2787] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:50.566282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:50.636371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371e2e1-c662-417a-8858-aa2e816bbeef service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:50.642808 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:50.643687 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:50.643965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:50.644232 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] PATH_INFO: `/v3/users/44bff490dcdc444fa927dd7516c92bce` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:50.645673 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44bff490dcdc444fa927dd7516c92bce)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:50.647643 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:50.709775 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44bff490dcdc444fa927dd7516c92bce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:50.718301 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44bff490dcdc444fa927dd7516c92bce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:50.735852 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44bff490dcdc444fa927dd7516c92bce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:50.736555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44bff490dcdc444fa927dd7516c92bce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:50.743571 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44bff490dcdc444fa927dd7516c92bce'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:50.749777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1392/2788] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:50 2022] DELETE /identity/v3/users/44bff490dcdc444fa927dd7516c92bce => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:50.755323 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:50.755820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:50.755936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:50.778767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:53:50.780001 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:50.842577 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1397/2789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:53:50.852847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:50.854462 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:50.906626 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:50.920780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bcb676-2556-41fd-b9ae-a44239e35619 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:50.925999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:50.926685 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:50.926965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:50.927240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:50.936897 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:50.938417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:50.948329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1393/2790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:53:51.247151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:51.248739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:51.257585 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=100 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:53:51.262263 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df0082-a5b8-458e-bc53-cee08425cf96 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:51.268208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:51.269103 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:51.269355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:51.269660 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] PATH_INFO: `/v3/projects/6c2a9bb5f31746f8b1a8de944bfcb0f0` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:51.270917 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2a9bb5f31746f8b1a8de944bfcb0f0)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:51.272866 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:51.321234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2a9bb5f31746f8b1a8de944bfcb0f0', 'request_id': 'req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.327379 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2a9bb5f31746f8b1a8de944bfcb0f0', 'request_id': 'req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.334161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2a9bb5f31746f8b1a8de944bfcb0f0', 'request_id': 'req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.348704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] The token cache is being invalidate because project 6c2a9bb5f31746f8b1a8de944bfcb0f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:51.348910 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.349510 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.351132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1398/2791] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:51 2022] DELETE /identity/v3/projects/6c2a9bb5f31746f8b1a8de944bfcb0f0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:53:51.355519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:51.365370 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e16391-35ce-4e44-b3d2-f79b4da390f6 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:51.426252 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:51.427208 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:51.427464 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:51.427744 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] PATH_INFO: `/v3/users/55382fc5a34c496ca2d8c0a66179ee93` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:51.428967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] RBAC: Authorizing `identity:delete_user(user_id=55382fc5a34c496ca2d8c0a66179ee93)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:51.430952 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:51.482494 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55382fc5a34c496ca2d8c0a66179ee93'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.491288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55382fc5a34c496ca2d8c0a66179ee93'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.504134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55382fc5a34c496ca2d8c0a66179ee93'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.504857 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55382fc5a34c496ca2d8c0a66179ee93'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.512436 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55382fc5a34c496ca2d8c0a66179ee93'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.519359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1394/2792] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:53:51 2022] DELETE /identity/v3/users/55382fc5a34c496ca2d8c0a66179ee93 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:53:51.823381 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:53:51.824874 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:53:51.839913 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176ca3f-e27e-489e-adc3-c8ce69a3b4e4 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:53:51.908485 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:53:51.909824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:53:51.910301 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:53:51.910742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] PATH_INFO: `/v3/projects/4c94a16b82c74fc1a4be3478f1266da2` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:53:51.912587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c94a16b82c74fc1a4be3478f1266da2)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:53:51.915707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:53:51.979541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c94a16b82c74fc1a4be3478f1266da2', 'request_id': 'req-9f397e9a-890c-4dfe-bfb0-f13b400723fe'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.985881 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c94a16b82c74fc1a4be3478f1266da2', 'request_id': 'req-9f397e9a-890c-4dfe-bfb0-f13b400723fe'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:51.993503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c94a16b82c74fc1a4be3478f1266da2', 'request_id': 'req-9f397e9a-890c-4dfe-bfb0-f13b400723fe'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:52.008557 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] The token cache is being invalidate because project 4c94a16b82c74fc1a4be3478f1266da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:53:52.008847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:52.009492 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:53:52.011085 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1399/2793] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:53:51 2022] DELETE /identity/v3/projects/4c94a16b82c74fc1a4be3478f1266da2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:01.514896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=59,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:02.005117 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=77,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:18.999959 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:19.001539 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:19.070772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b11b19-49e9-44f0-92d2-53a8d036d89f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:19.125336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:19.126077 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:19.126395 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:19.126694 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:19.128799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:19.200265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:19.201668 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:19.212248 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1395/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:22.605575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:22.605575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:22.619893 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397e9a-890c-4dfe-bfb0-f13b400723fe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:22.626747 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:22.627709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:22.628018 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:22.628292 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] PATH_INFO: `/v3/users/b6173a38d9234fb383c0ba017e459372` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:22.629500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6173a38d9234fb383c0ba017e459372)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:22.631488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:22.707641 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6173a38d9234fb383c0ba017e459372'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:22.715939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6173a38d9234fb383c0ba017e459372'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:22.716863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6173a38d9234fb383c0ba017e459372'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:22.728260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6173a38d9234fb383c0ba017e459372'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:22.728979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-cc6e4298-930a-4886-87e5-c0aa62b8fd0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6173a38d9234fb383c0ba017e459372'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:22.750034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1400/2795] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:22 2022] DELETE /identity/v3/users/b6173a38d9234fb383c0ba017e459372 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:22.937670 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:22.951507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d417ab0-719a-427a-8eb7-e07192190c7c service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.018087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.018986 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.019261 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.019530 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] PATH_INFO: `/v3/projects/5c45b12dc0ce4d0a86fcc176c0cf3d67` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.020728 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c45b12dc0ce4d0a86fcc176c0cf3d67)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.022831 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.032491 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:23.074552 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'request_id': 'req-53f239ed-f0fa-491b-b5bf-f239eae4577c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:23.082786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'request_id': 'req-53f239ed-f0fa-491b-b5bf-f239eae4577c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:23.089886 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c45b12dc0ce4d0a86fcc176c0cf3d67', 'request_id': 'req-53f239ed-f0fa-491b-b5bf-f239eae4577c'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:23.101140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] The token cache is being invalidate because project 5c45b12dc0ce4d0a86fcc176c0cf3d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:23.101390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:23.102234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-53f239ed-f0fa-491b-b5bf-f239eae4577c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:23.103901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1396/2796] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:22 2022] DELETE /identity/v3/projects/5c45b12dc0ce4d0a86fcc176c0cf3d67 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:23.109397 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.109690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.109972 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.128675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:23.129905 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:23.197479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1401/2797] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:23.205535 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586503d-c769-4c49-8152-2947d1061082 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.205829 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586503d-c769-4c49-8152-2947d1061082 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.206107 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7586503d-c769-4c49-8152-2947d1061082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.226887 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7586503d-c769-4c49-8152-2947d1061082 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:23.228166 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7586503d-c769-4c49-8152-2947d1061082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:23.237509 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1397/2798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:23.242016 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.252888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f3116b-9b83-48bd-91a9-e95cb1ae0b90 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.258083 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.258932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.259212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.259486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.260218 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:54:23.260525 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.262212 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.275186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1402/2799] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:54:23.279729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586503d-c769-4c49-8152-2947d1061082 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.289060 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7586503d-c769-4c49-8152-2947d1061082 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.294456 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.295120 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.295399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.295672 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.296359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.298305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.326305 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1398/2800] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:23 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:23.331997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.343482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb7924-23c2-4a64-a83c-9285ca48867e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.402597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.403189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.403470 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.403740 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.404441 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.406437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.413223 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:23.429056 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1403/2801] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:23 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:23.433729 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.444929 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d88d2e-e640-4d82-89bc-45484f10e09d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.450637 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.451344 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.451628 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.451904 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.452674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.454380 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.467211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1399/2802] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:23.471903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.483316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e41543-ea11-4130-9257-b03f094f51de admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.488860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.489542 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.489832 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.490140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.490864 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.492604 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad2d570-7805-47ac-8d8e-f81721aefc93 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.504041 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1404/2803] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:23.508805 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.522466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11000768-b2b1-498d-be27-c46b5909115d admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.528006 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.528941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.529220 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.529495 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] PATH_INFO: `/v3/projects/e503ffcf364e4767a1335f12a9437a27/users/7ae069ecc4e24494a07f7b3f30795461/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.545408 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e503ffcf364e4767a1335f12a9437a27, user_id=7ae069ecc4e24494a07f7b3f30795461, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.548134 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.565242 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1400/2804] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:23 2022] PUT /identity/v3/projects/e503ffcf364e4767a1335f12a9437a27/users/7ae069ecc4e24494a07f7b3f30795461/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:23.579176 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.579548 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.579908 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.611698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] MFA Rules not processed for user `7ae069ecc4e24494a07f7b3f30795461`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:23.613059 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:23.684498 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1405/2805] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:23.697695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:23.699061 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:23.804048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fb016-7c96-4940-8413-8bda43b7c266 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:23.810482 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:23.811142 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:23.811425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:23.811703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:23.822389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:23.824016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe46726-6af4-4ebd-abf7-23efe599767f service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:23.833936 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1401/2806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:24.081505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:24.150850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c3c71-0370-401d-bcc4-888553f3df53 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:24.156098 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:24.156983 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.157261 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.157532 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] PATH_INFO: `/v3/users/7ae069ecc4e24494a07f7b3f30795461` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.158733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ae069ecc4e24494a07f7b3f30795461)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:24.160690 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:24.215513 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ae069ecc4e24494a07f7b3f30795461'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.225565 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ae069ecc4e24494a07f7b3f30795461'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.226433 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ae069ecc4e24494a07f7b3f30795461'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.237704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ae069ecc4e24494a07f7b3f30795461'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.238436 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ae069ecc4e24494a07f7b3f30795461'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.245276 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:24.261209 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1406/2807] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:24 2022] DELETE /identity/v3/users/7ae069ecc4e24494a07f7b3f30795461 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:24.265910 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.266448 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.266549 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.284269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:24.285480 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:24.297883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:24.347377 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1402/2808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:24.358745 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:24.360252 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:24.427834 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db84d90-b14a-46f1-b063-28bca6bc50fe admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:24.432329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:24.432478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.432847 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.433318 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.448133 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:24.451220 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a80f2-b6b9-48ad-a64e-e294744a5d33 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:24.462404 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1407/2809] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:54:24.755759 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:24.757328 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:24.771158 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d13c4cd-1e2b-4df7-be0c-b5c7135fd19d None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:24.776693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:24.777573 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.777872 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.778177 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] PATH_INFO: `/v3/projects/e503ffcf364e4767a1335f12a9437a27` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.779421 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e503ffcf364e4767a1335f12a9437a27)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:24.781363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:24.832345 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e503ffcf364e4767a1335f12a9437a27', 'request_id': 'req-a6d8ad93-494d-4e91-89f5-6469306da720'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.840574 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e503ffcf364e4767a1335f12a9437a27', 'request_id': 'req-a6d8ad93-494d-4e91-89f5-6469306da720'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.847019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e503ffcf364e4767a1335f12a9437a27', 'request_id': 'req-a6d8ad93-494d-4e91-89f5-6469306da720'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.857271 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] The token cache is being invalidate because project e503ffcf364e4767a1335f12a9437a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:24.857561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.858243 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-a6d8ad93-494d-4e91-89f5-6469306da720 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:24.859809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1403/2810] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:24 2022] DELETE /identity/v3/projects/e503ffcf364e4767a1335f12a9437a27 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:24.864749 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.865240 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.865352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.883307 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:24.885081 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:24.949186 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1408/2811] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:24.957257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:24.957537 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:24.957836 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:24.976964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:24.978233 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:24.987522 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1404/2812] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:24.992208 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.005965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ea556-614b-468e-b386-2c9d70f75021 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.014611 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.015505 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.015807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.016123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.017187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:54:25.017552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.020005 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.034591 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1409/2813] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:54:25.041276 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.056199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977169bd-6e23-4c81-93ad-a9b0ba8bdebb None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.062569 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.063229 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.063512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.063792 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.064490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.066457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.096246 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1405/2814] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:25.100048 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.110625 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3fce4-25f1-497b-a304-c8d086c93816 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.180308 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.180974 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.181272 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.182087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.182994 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.184932 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.207503 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1410/2815] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/users => generated 297 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:25.211727 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.222750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd1538-854e-4c17-a7ae-0b3b7f9b6087 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.228329 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.229019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.229302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.229567 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.230338 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.231953 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.243683 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1406/2816] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:25.248368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.261521 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d3ffdf-ba3b-4a87-8411-52b94b65f591 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.269584 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.270675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.271150 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.271556 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.272709 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.274750 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e535e8-8ada-4704-a32e-68afd37163b1 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.276902 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:25.291138 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1411/2817] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:25.295428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.308603 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a040a3-5fa2-4f96-9c8a-18f07db4d61b admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.315035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.315951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.316234 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.316510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] PATH_INFO: `/v3/projects/2cc89d2a0a194fed804566f8c6ea112a/users/21875df0c8f945338ddd42c30a76305a/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.335618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cc89d2a0a194fed804566f8c6ea112a, user_id=21875df0c8f945338ddd42c30a76305a, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.338561 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.353386 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1407/2818] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:25 2022] PUT /identity/v3/projects/2cc89d2a0a194fed804566f8c6ea112a/users/21875df0c8f945338ddd42c30a76305a/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:25.364890 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.365179 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.365450 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.394693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] MFA Rules not processed for user `21875df0c8f945338ddd42c30a76305a`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:25.395929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:25.466589 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1412/2819] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:25.471354 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.515352 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:25.538675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed358a2d-b109-4610-a053-5926fb9d4acd admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.546183 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.546889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.547209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.547505 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.548200 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.550197 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.582661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1408/2820] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/projects => generated 393 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:54:25.587313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.598844 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4910c6-f0af-4f45-b34f-4a5843dc50a2 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.659393 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.660079 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.660359 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.660633 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.661329 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.663309 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.689360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1413/2821] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:25.694960 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.706356 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302a96fc-174f-4e2b-81a5-731e97924829 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.711298 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.711969 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.712253 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.712532 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.713265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.715389 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.726435 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1409/2822] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:25.731668 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.743965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e4063-5647-4685-aad8-a97bd220fcda admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.750880 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.751833 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.752110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.752369 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] PATH_INFO: `/v3/projects/6ac1e70338db47da96514d5cc286a6d3/users/903b124228484528b1232abf0b7b7290/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.772729 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac1e70338db47da96514d5cc286a6d3, user_id=903b124228484528b1232abf0b7b7290, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.775424 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.792170 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1414/2823] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:25 2022] PUT /identity/v3/projects/6ac1e70338db47da96514d5cc286a6d3/users/903b124228484528b1232abf0b7b7290/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:25.797927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.812326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f3a6e-6df5-4a1e-be1a-c4cdbbb7100a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.876336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.877011 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.877288 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.877564 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.878319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.879927 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e14f67-7411-41aa-8f1f-b78d87d949d7 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.890533 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1410/2824] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:25.895052 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:25.906829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7738329f-6e34-4185-a644-5a1850afda7a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:25.911761 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:25.912826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.913118 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.913390 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] PATH_INFO: `/v3/projects/6ac1e70338db47da96514d5cc286a6d3/users/903b124228484528b1232abf0b7b7290/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.915389 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac1e70338db47da96514d5cc286a6d3, user_id=903b124228484528b1232abf0b7b7290, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:25.918474 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:25.928714 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1415/2825] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:25 2022] PUT /identity/v3/projects/6ac1e70338db47da96514d5cc286a6d3/users/903b124228484528b1232abf0b7b7290/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:25.941722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:25.942209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:25.942639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:25.979995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] MFA Rules not processed for user `903b124228484528b1232abf0b7b7290`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:25.981227 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:26.057605 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1411/2826] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:26.068558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:26.070888 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:26.120332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:26.138123 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31371fa4-6c4c-4101-a854-1cb990fb6566 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:26.141912 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:26.142586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:26.142867 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:26.143140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:26.152789 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:26.154274 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:26.163752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1416/2827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:26.227722 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:26.229336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:26.241609 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520faa6-c658-4aac-8ffa-71e9f62d0449 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:26.246314 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:26.247148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:26.247429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:26.247701 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:26.280557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:26.312675 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:26.314027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb368b-8946-4d75-8041-38d2e3d625d5 service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:26.324057 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1412/2828] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:29.710939 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:29.778375 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b460-bec6-4dc4-bff3-32db82133421 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:29.783597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:29.784423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:29.784713 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:29.784999 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] PATH_INFO: `/v3/users/21875df0c8f945338ddd42c30a76305a` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:29.786296 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21875df0c8f945338ddd42c30a76305a)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:29.788260 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:29.863193 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21875df0c8f945338ddd42c30a76305a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:29.871047 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21875df0c8f945338ddd42c30a76305a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:29.871827 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21875df0c8f945338ddd42c30a76305a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:29.882096 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21875df0c8f945338ddd42c30a76305a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:29.882757 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21875df0c8f945338ddd42c30a76305a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:29.903838 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1417/2829] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:29 2022] DELETE /identity/v3/users/21875df0c8f945338ddd42c30a76305a => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:29.908780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:29.909317 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:29.909444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:29.927915 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:29.929128 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:29.996885 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1413/2830] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:30.006951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:30.008458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:30.069165 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6242f77-7987-4b39-9cdb-b5b8e565756a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:30.075959 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:30.076606 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:30.076889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:30.077162 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:30.087753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:30.089222 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:30.099680 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1418/2831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:30.391387 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:30.392889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:30.405901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dfe2b4-ae79-4bbf-b93a-5389b65c2803 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:30.413608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:30.414795 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:30.415082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:30.415465 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] PATH_INFO: `/v3/projects/2cc89d2a0a194fed804566f8c6ea112a` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:30.416807 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cc89d2a0a194fed804566f8c6ea112a)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:30.419895 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:30.472742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cc89d2a0a194fed804566f8c6ea112a', 'request_id': 'req-47167720-b0b3-4466-95cc-a4eb2328746a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.481277 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cc89d2a0a194fed804566f8c6ea112a', 'request_id': 'req-47167720-b0b3-4466-95cc-a4eb2328746a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.488069 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cc89d2a0a194fed804566f8c6ea112a', 'request_id': 'req-47167720-b0b3-4466-95cc-a4eb2328746a'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.498822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] The token cache is being invalidate because project 2cc89d2a0a194fed804566f8c6ea112a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:30.499110 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.499772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.501368 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1414/2832] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:30 2022] DELETE /identity/v3/projects/2cc89d2a0a194fed804566f8c6ea112a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:30.505609 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:30.510737 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:30.516337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e39f6-fbee-4509-a19c-196ee0638477 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:30.579114 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:30.579995 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:30.580271 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:30.580567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] PATH_INFO: `/v3/users/903b124228484528b1232abf0b7b7290` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:30.581779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=903b124228484528b1232abf0b7b7290)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:30.583826 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:30.633090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '903b124228484528b1232abf0b7b7290'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.640447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '903b124228484528b1232abf0b7b7290'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.641184 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '903b124228484528b1232abf0b7b7290'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.649214 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '903b124228484528b1232abf0b7b7290'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.649813 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-627fa1ed-f7bd-4df0-91e5-dfc39ae04bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '903b124228484528b1232abf0b7b7290'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:30.668068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1419/2833] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:30 2022] DELETE /identity/v3/users/903b124228484528b1232abf0b7b7290 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:30.956521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:30.958035 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:30.971801 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47167720-b0b3-4466-95cc-a4eb2328746a admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.025459 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:31.033265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.035054 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.035712 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.036607 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] PATH_INFO: `/v3/projects/6ac1e70338db47da96514d5cc286a6d3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.037822 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac1e70338db47da96514d5cc286a6d3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.040187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.089700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac1e70338db47da96514d5cc286a6d3', 'request_id': 'req-b62ef6d0-58f9-4309-8ecd-4456912b4935'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:31.099883 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac1e70338db47da96514d5cc286a6d3', 'request_id': 'req-b62ef6d0-58f9-4309-8ecd-4456912b4935'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:31.107302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac1e70338db47da96514d5cc286a6d3', 'request_id': 'req-b62ef6d0-58f9-4309-8ecd-4456912b4935'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:31.120029 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] The token cache is being invalidate because project 6ac1e70338db47da96514d5cc286a6d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:31.120353 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:31.121257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-b62ef6d0-58f9-4309-8ecd-4456912b4935 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:31.123743 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1415/2834] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:30 2022] DELETE /identity/v3/projects/6ac1e70338db47da96514d5cc286a6d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:31.129107 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.129649 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.129753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.148665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:31.149894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:31.223012 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1420/2835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:31.232715 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.232962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.233270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.256841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:31.258093 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:31.268132 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1416/2836] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:31.272610 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.283188 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b18e-573d-4b17-b60f-3d03c7a2d737 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.288483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.289151 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.289423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.289692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] PATH_INFO: `/v3/domains` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.290482 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80174) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:54:31.290787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.292410 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.304652 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1421/2837] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:54:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:54:31.309043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.318572 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a6422-a83d-4381-8f76-b658051e3e67 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.323821 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.324472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.324753 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.325028 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.325717 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.327972 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.361145 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1417/2838] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:31.365455 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.376153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a34558-5f75-41db-acda-2a06c460438e admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.381517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:31.440445 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.441122 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.441409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.441670 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.442409 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.444701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.467849 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1422/2839] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:54:31.473267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.487645 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f4119f-90fc-4311-b539-f50286c486b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.492954 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.493625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.493907 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.494210 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.494941 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.496588 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.507957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1418/2840] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:31.512075 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.522903 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b45cbce-6480-4ab2-a19e-3ccd0e8f7801 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.528140 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.528806 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.529094 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.529394 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.530153 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.531733 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2f5ef-8e21-4d87-918b-d3d5fb758c26 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.542071 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1423/2841] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:31.548634 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.563619 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e5dd1-ae67-4f91-80ba-e52be3a7e051 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.570334 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.571225 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.571540 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.571814 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] PATH_INFO: `/v3/projects/75721625d1e7428097fc445e8dc70808/users/6248a06cd156456ca4667c6659301764/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.589449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75721625d1e7428097fc445e8dc70808, user_id=6248a06cd156456ca4667c6659301764, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.592265 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.610664 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1419/2842] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:31 2022] PUT /identity/v3/projects/75721625d1e7428097fc445e8dc70808/users/6248a06cd156456ca4667c6659301764/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:31.622116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.622443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.622751 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.652385 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] MFA Rules not processed for user `6248a06cd156456ca4667c6659301764`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:31.653554 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:31.720230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1424/2843] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:31.725039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.791403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a2b31-d61a-4642-ba4c-a984e516df93 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.796754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.797417 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.797698 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.797975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.798771 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.800693 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.827864 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1420/2844] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:31.832644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.847631 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d7dca6-9dcb-4af2-928f-e055be6c838a None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.906862 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.907547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.907836 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.908115 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.908951 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.910992 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.934990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1425/2845] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:31 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:31.939296 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.952150 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e145cfa0-b4c2-4634-96b9-c385c5fde678 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.957786 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.958445 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.958742 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.959020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.959756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.961390 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.962813 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:31.974264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1421/2846] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:31.978234 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:31.988850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a694de-2667-4ebf-af77-de74f07d7a77 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:31.993776 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:31.994495 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:31.994781 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:31.995061 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:31.995797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:31.997426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b6fac-a900-40f8-879b-2dc5018d4fd4 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:31.998772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:32.009868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1426/2847] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:32.014409 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.024700 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a53ed3-b91c-440d-8ba6-129374e6e7c1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.030071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.030639 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.030921 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.031206 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] PATH_INFO: `/v3/projects/8eace80166eb496798efe2fd62689fc3/users/3f16f45add58490392a2bb415fc7c6e3/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.046979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eace80166eb496798efe2fd62689fc3, user_id=3f16f45add58490392a2bb415fc7c6e3, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.049732 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.064799 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1422/2848] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:32 2022] PUT /identity/v3/projects/8eace80166eb496798efe2fd62689fc3/users/3f16f45add58490392a2bb415fc7c6e3/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:32.077707 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.078033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.078344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.106816 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] MFA Rules not processed for user `3f16f45add58490392a2bb415fc7c6e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:32.108242 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:32.184550 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1427/2849] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:32.189460 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.256270 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0045ef-b4dc-496a-afac-0cf62b68e4ae admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.261809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.262523 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.262806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.263083 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.263985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.266098 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.296294 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1423/2850] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:32 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 21 10:54:32.301824 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.313452 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5069bbc6-2a0f-4032-95b5-58a4d31e8baf None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.374596 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.375280 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.375564 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.375871 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.376562 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.378558 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.400582 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1428/2851] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:32 2022] POST /identity/v3/users => generated 299 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:32.404933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.416045 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32388aa-df67-496d-8209-19dd3624b516 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.422041 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.422767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.423026 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.423307 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.424048 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.425661 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.437211 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1424/2852] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:32.441672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.452978 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813b5635-2cce-43d7-a692-86919e839e02 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.457822 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.458742 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.459013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.459288 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] PATH_INFO: `/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d/users/571474bc1a924231935117fdbe926cdf/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.474986 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b8c43aaf2c4b909ad6006da3ef591d, user_id=571474bc1a924231935117fdbe926cdf, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.477900 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.493875 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1429/2853] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:32 2022] PUT /identity/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d/users/571474bc1a924231935117fdbe926cdf/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:32.499659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.509997 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa715a-f739-438f-ab80-0719d1d811df admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.586956 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.587894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.588295 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.588682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.589815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.592364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537f466-8558-4892-b400-cfdd9d903cff admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.603017 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1425/2854] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:32.607632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.619726 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b20eda-8aa6-493a-ba05-5fc38c790fa8 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.626704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.627608 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.627894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.628168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] PATH_INFO: `/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d/users/571474bc1a924231935117fdbe926cdf/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.630431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b8c43aaf2c4b909ad6006da3ef591d, user_id=571474bc1a924231935117fdbe926cdf, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.633131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.644736 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1430/2855] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:32 2022] PUT /identity/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d/users/571474bc1a924231935117fdbe926cdf/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:32.655428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.655718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.655995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.684479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] MFA Rules not processed for user `571474bc1a924231935117fdbe926cdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:32.685876 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:32.720740 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:32.761611 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1426/2856] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:32.773362 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:32.775431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:32.836246 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:32.854257 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2740eb-30ad-4920-91db-ee82d4216a96 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:32.859567 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:32.860199 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:32.860478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:32.860755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:32.924037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:32.925479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:32.934453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1431/2857] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:34.471650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:34.473593 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:34.489360 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2b04-40cc-4e73-84d5-86e40381c652 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:34.493399 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:34.494080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:34.494405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:34.494680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:34.564269 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:34.565731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:34.575472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1427/2858] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:35.151143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:35.160642 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cceec-b4fa-4610-82ec-29c3801ec4c8 service cinder] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:35.164665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:35.165313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:35.165597 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:35.165873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:35.175580 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:35.177172 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717c4d3e-2325-46b1-843f-02a1f5574dd9 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:35.186632 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1432/2859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:39.124618 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:39.191518 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98a7b-fb09-4426-8c0e-369911d3ab0e service cinder] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:39.197237 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:39.198144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:39.198419 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:39.198676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] PATH_INFO: `/v3/users/6248a06cd156456ca4667c6659301764` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:39.199882 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6248a06cd156456ca4667c6659301764)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:39.201812 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:39.255216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6248a06cd156456ca4667c6659301764'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.263789 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6248a06cd156456ca4667c6659301764'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.276129 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:39.278958 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6248a06cd156456ca4667c6659301764'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.280186 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6248a06cd156456ca4667c6659301764'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.289756 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6248a06cd156456ca4667c6659301764'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.295674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1428/2860] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:39 2022] DELETE /identity/v3/users/6248a06cd156456ca4667c6659301764 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:39.300437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:39.300990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:39.300990 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:39.323132 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:39.324267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:39.390787 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1433/2861] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:39.404404 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:39.406650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:39.479834 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d84de-7d8e-46c3-a5f3-810ce876239f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:39.484534 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:39.485192 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:39.485466 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:39.485736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:39.496043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:39.497520 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:39.507828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1429/2862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:39.798413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:39.800232 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:39.815405 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba1d478-ba01-4808-be4c-5ee6e4d2745e None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:39.821277 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:39.822187 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:39.822464 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:39.822753 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] PATH_INFO: `/v3/projects/75721625d1e7428097fc445e8dc70808` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:39.823942 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75721625d1e7428097fc445e8dc70808)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:39.825960 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:39.877656 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75721625d1e7428097fc445e8dc70808', 'request_id': 'req-396f3857-21d8-4222-9b9f-3f84ecd1bc68'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.883458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75721625d1e7428097fc445e8dc70808', 'request_id': 'req-396f3857-21d8-4222-9b9f-3f84ecd1bc68'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.889701 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75721625d1e7428097fc445e8dc70808', 'request_id': 'req-396f3857-21d8-4222-9b9f-3f84ecd1bc68'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.905264 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] The token cache is being invalidate because project 75721625d1e7428097fc445e8dc70808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:39.905552 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.906298 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:39.907885 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1434/2863] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:39 2022] DELETE /identity/v3/projects/75721625d1e7428097fc445e8dc70808 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:54:39.912180 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:39.922267 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33061b8-c74c-4d76-8f10-f920d883b810 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:39.982072 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:39.982975 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:39.983274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:39.983543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] PATH_INFO: `/v3/users/3f16f45add58490392a2bb415fc7c6e3` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:39.984888 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f16f45add58490392a2bb415fc7c6e3)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:39.986877 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:40.047429 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f16f45add58490392a2bb415fc7c6e3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.058777 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f16f45add58490392a2bb415fc7c6e3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.071967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f16f45add58490392a2bb415fc7c6e3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.072625 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f16f45add58490392a2bb415fc7c6e3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.079410 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f16f45add58490392a2bb415fc7c6e3'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.086984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1430/2864] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:39 2022] DELETE /identity/v3/users/3f16f45add58490392a2bb415fc7c6e3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:40.381337 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:40.382889 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:40.391032 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:40.399200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f3857-21d8-4222-9b9f-3f84ecd1bc68 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:40.472089 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:40.473026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:40.473313 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:40.473587 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] PATH_INFO: `/v3/projects/8eace80166eb496798efe2fd62689fc3` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:40.474968 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eace80166eb496798efe2fd62689fc3)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:40.477013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:40.540104 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eace80166eb496798efe2fd62689fc3', 'request_id': 'req-eea32904-c803-469b-af70-01247a70bb53'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.549033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eace80166eb496798efe2fd62689fc3', 'request_id': 'req-eea32904-c803-469b-af70-01247a70bb53'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.560189 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eace80166eb496798efe2fd62689fc3', 'request_id': 'req-eea32904-c803-469b-af70-01247a70bb53'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.576336 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] The token cache is being invalidate because project 8eace80166eb496798efe2fd62689fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:40.576622 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.577254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.578856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1435/2865] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:40 2022] DELETE /identity/v3/projects/8eace80166eb496798efe2fd62689fc3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:40.583363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:40.584843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:40.598351 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfd22b-d8a7-4a39-9fdf-1ced5eb220b4 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:40.602788 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:40.659713 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:40.660519 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:40.660800 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:40.661075 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] PATH_INFO: `/v3/users/571474bc1a924231935117fdbe926cdf` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:40.662336 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571474bc1a924231935117fdbe926cdf)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:40.664297 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:40.720655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571474bc1a924231935117fdbe926cdf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.730981 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571474bc1a924231935117fdbe926cdf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.747745 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571474bc1a924231935117fdbe926cdf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.748847 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571474bc1a924231935117fdbe926cdf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.757896 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-fb58665a-4686-4c41-a443-15078a1b8d05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571474bc1a924231935117fdbe926cdf'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:40.764187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1431/2866] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:40 2022] DELETE /identity/v3/users/571474bc1a924231935117fdbe926cdf => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:41.053253 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.054500 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:41.072152 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea32904-c803-469b-af70-01247a70bb53 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.135700 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.136568 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.136850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.137125 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] PATH_INFO: `/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.138360 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b8c43aaf2c4b909ad6006da3ef591d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.140291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.190778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:41.203191 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b8c43aaf2c4b909ad6006da3ef591d', 'request_id': 'req-be3faa13-e9c5-4435-8088-7f7eb3ea675a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:41.209907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b8c43aaf2c4b909ad6006da3ef591d', 'request_id': 'req-be3faa13-e9c5-4435-8088-7f7eb3ea675a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:41.216422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b8c43aaf2c4b909ad6006da3ef591d', 'request_id': 'req-be3faa13-e9c5-4435-8088-7f7eb3ea675a'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:41.232512 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] The token cache is being invalidate because project 30b8c43aaf2c4b909ad6006da3ef591d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:41.232803 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:41.233407 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-be3faa13-e9c5-4435-8088-7f7eb3ea675a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:41.235030 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1436/2867] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:41 2022] DELETE /identity/v3/projects/30b8c43aaf2c4b909ad6006da3ef591d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:41.242846 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.243282 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.243671 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.267961 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:41.269841 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:41.345039 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1432/2868] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:41.358576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.358873 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.359203 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.383856 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:41.385070 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:41.397829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1437/2869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:41.403780 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.415472 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba12f4f-e2ce-40d7-87de-b10398889813 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.421259 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.421918 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.422413 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.422690 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.423428 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:54:41.423737 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.425510 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.438070 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1433/2870] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 21 10:54:41.443110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.453762 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715f9c3-34fc-4dd7-8108-e7aa4da5e3e0 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.459906 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.460574 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.460857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.461130 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.461829 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.463814 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.493692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1438/2871] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:41 2022] POST /identity/v3/projects => generated 399 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:41.498359 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.509937 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbf59a-12a1-4e01-988a-cde6b6d37e41 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.520470 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:41.573581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.574543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.574856 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.575188 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.576463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.579398 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.605796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1434/2872] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:41 2022] POST /identity/v3/users => generated 300 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:41.610401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.621672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36772568-3b2c-40f6-8577-01f5993cb55a admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.626988 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.627773 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.628068 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.628545 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.629289 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.630967 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.642013 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1439/2873] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:41.647051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.658608 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a1afe-c907-4228-bf1a-f17cad2fdd52 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.664581 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.665318 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.665606 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.665965 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.666676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.668342 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c309a1-62e5-473b-b7f2-79b10c694c5c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.683010 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1435/2874] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:41.684846 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.696027 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8404fa3-3861-4fdd-9cc4-cd82fad42ebd admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.701569 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.702497 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.702779 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.703050 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] PATH_INFO: `/v3/projects/a18cd65ddbe346b9ba693630e880774d/users/c7e4381ad0774d9c9cf0cda4c73123e4/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.719064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18cd65ddbe346b9ba693630e880774d, user_id=c7e4381ad0774d9c9cf0cda4c73123e4, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.722131 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.737907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1440/2875] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:41 2022] PUT /identity/v3/projects/a18cd65ddbe346b9ba693630e880774d/users/c7e4381ad0774d9c9cf0cda4c73123e4/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:41.748629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.748998 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.749285 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.778113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] MFA Rules not processed for user `c7e4381ad0774d9c9cf0cda4c73123e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:41.779378 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:41.844383 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1436/2876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:41 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:41.856412 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:41.858357 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:41.917807 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592f4c7-2236-40be-ba48-e81921b7a52c admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:41.921936 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8fcad6f0eae4e41891963dfd5b05042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:41.922627 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:41.922907 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:41.923205 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:41.934157 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:41.936443 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cb99e-23f9-46c3-b5f1-f6ea762f5f36 service cinder] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:41.952791 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1441/2877] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:41 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:50.097718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:50.170204 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf5b84-88ab-4751-ac12-6c8bd47bf02c None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:50.176488 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:50.177433 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:50.177714 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:50.177984 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] PATH_INFO: `/v3/users/c7e4381ad0774d9c9cf0cda4c73123e4` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:50.179424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e4381ad0774d9c9cf0cda4c73123e4)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:50.181405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:50.206199 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:50.240985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e4381ad0774d9c9cf0cda4c73123e4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.250213 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e4381ad0774d9c9cf0cda4c73123e4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.266113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e4381ad0774d9c9cf0cda4c73123e4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.267085 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e4381ad0774d9c9cf0cda4c73123e4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.276254 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e4381ad0774d9c9cf0cda4c73123e4'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.282750 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1437/2878] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:54:50 2022] DELETE /identity/v3/users/c7e4381ad0774d9c9cf0cda4c73123e4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:50.287508 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:50.288034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:50.288143 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:50.306777 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:50.308006 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:50.373872 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1442/2879] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:50.387766 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:50.389781 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:50.459869 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2b843-1409-4ea5-adba-6cb9272275b1 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:50.465531 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:50.466266 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:50.466551 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:50.466843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:50.479002 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:50.480785 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a451862-f273-449f-a733-263d2f17e1c8 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:50.491469 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1438/2880] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:50.792207 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:50.793793 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:50.801053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:50.808828 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5999681-bc82-4ce4-878a-6798b7bedb96 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:50.815365 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:50.816251 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:50.816543 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:50.816831 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] PATH_INFO: `/v3/projects/a18cd65ddbe346b9ba693630e880774d` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:50.818744 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18cd65ddbe346b9ba693630e880774d)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:50.821090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:50.872769 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18cd65ddbe346b9ba693630e880774d', 'request_id': 'req-751bc174-be64-496e-a3b5-27b6cafbd17e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.878287 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18cd65ddbe346b9ba693630e880774d', 'request_id': 'req-751bc174-be64-496e-a3b5-27b6cafbd17e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.884884 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18cd65ddbe346b9ba693630e880774d', 'request_id': 'req-751bc174-be64-496e-a3b5-27b6cafbd17e'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.906752 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] The token cache is being invalidate because project a18cd65ddbe346b9ba693630e880774d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80174) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:54:50.907033 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.907640 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-751bc174-be64-496e-a3b5-27b6cafbd17e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:54:50.909316 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1443/2881] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:54:50 2022] DELETE /identity/v3/projects/a18cd65ddbe346b9ba693630e880774d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:50.915663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:50.915951 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:50.916235 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:50.934555 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:50.935765 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:51.003278 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1439/2882] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:51.011506 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.011797 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.012116 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.032168 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:51.033387 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:51.042166 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1444/2883] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:51.046767 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.057140 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005b7be-1384-444f-936d-b81fd13bf687 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.062710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.063371 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.063659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.063934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.064692 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80175) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 21 10:54:51.064995 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.066680 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.079117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1440/2884] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jun 21 10:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 21 10:54:51.083775 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.093400 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52001859-dbd5-4a6d-81eb-9348864db0e8 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.098466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.099229 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.099486 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.099766 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] PATH_INFO: `/v3/projects` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.100496 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.102458 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.132997 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1445/2885] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:51.137323 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.148144 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792e00d-0451-402c-9cb9-dad4479c61d3 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.177071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:51.207082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.208148 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.208764 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.209046 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] PATH_INFO: `/v3/users` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.209758 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.211730 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.234563 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1441/2886] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:51 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:51.240088 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.250623 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09a7f6-f347-4f7f-a07a-0f46cabb948d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.256743 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.257352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.257628 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.257896 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] PATH_INFO: `/v3/roles` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.258661 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.260410 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.272630 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1446/2887] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 21 10:54:51.276964 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.288439 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1ddbe-0beb-4558-9c71-59c2ef51d19f admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.293875 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.294586 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.294828 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.295125 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.295853 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.297473 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7a850-bcc2-4eb5-a032-7e2251d14bba admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.309823 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1442/2888] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:51.314364 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.325515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f3e8d-6ee1-4f7c-96ed-bd06b4da205d admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.330202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.331100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.331376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.331644 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] PATH_INFO: `/v3/projects/b0144da9d9c2404ba08c90e551b1e5c8/users/26196017350a47ac8633f6741a277006/roles/4ccbd5b0e5ba4d53aee626148246e880` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.349662 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0144da9d9c2404ba08c90e551b1e5c8, user_id=26196017350a47ac8633f6741a277006, role_id=4ccbd5b0e5ba4d53aee626148246e880)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.351693 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.368949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1447/2889] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:51 2022] PUT /identity/v3/projects/b0144da9d9c2404ba08c90e551b1e5c8/users/26196017350a47ac8633f6741a277006/roles/4ccbd5b0e5ba4d53aee626148246e880 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:54:51.374264 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.374557 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.374832 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.393447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] MFA Rules not processed for user `b6ff555140924a9182c287c0588e7e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:51.394702 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:51.457601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1443/2890] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:51.468181 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:51.470332 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:51.537541 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dd5e5-a44d-4877-a0d0-8ae86dc4ccc9 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:51.541857 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:51.542546 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:51.542820 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:51.543090 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:51.553681 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:51.555178 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe5037-da50-41c6-9183-b5f3b86beeb5 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:51.565325 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1448/2891] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:54:53.088706 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:53.091521 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:53.191496 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae7c06-5b2e-484c-b079-37f7084cb857 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:53.198731 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:53.199545 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:53.199934 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:53.200274 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:53.202247 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:53.219309 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:53.219568 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:53.230889 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1444/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:54:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:54:56.025918 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.026488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.026488 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.057137 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] MFA Rules not processed for user `26196017350a47ac8633f6741a277006`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:54:56.058408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:54:56.074965 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:56.137551 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1449/2893] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:54:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:54:56.138806 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.150901 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd0ab7-b599-45d9-8070-4077c32235e6 service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.155449 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.156123 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.156543 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.156962 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.157663 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.159796 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.193894 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1445/2894] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jun 21 10:54:56 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:56.198431 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.209575 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baec415-2bae-4346-8ea1-e3000dc3401d None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.274547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.275228 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.275515 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.275790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.276677 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.279401 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.303957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1450/2895] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jun 21 10:54:56 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 21 10:54:56.305326 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.316652 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a2ab7-5f6e-4dfe-9b58-4a2f288f84ef admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.323403 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.324086 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.324363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.324629 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.325363 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.327040 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.339987 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1446/2896] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:56.342805 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.353355 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f43f8aa-4407-4bf2-bb76-92f9bfa07e11 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.358501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.359472 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.359755 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.360025 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] PATH_INFO: `/v3/projects/c4f4b2d36876492ba14f5b521001c5e0/users/2a1a73abfe544e519cda25757dd212a1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.378423 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4b2d36876492ba14f5b521001c5e0, user_id=2a1a73abfe544e519cda25757dd212a1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.381704 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.396767 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1451/2897] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:56 2022] PUT /identity/v3/projects/c4f4b2d36876492ba14f5b521001c5e0/users/2a1a73abfe544e519cda25757dd212a1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 21 10:54:56.400868 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.412999 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095385-77e3-4ebc-a7ce-45ffedce621c admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.417303 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:54:56.473575 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.474405 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.474718 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.475051 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.475815 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.477440 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624396e-579d-418f-9b40-34791ac753d4 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.489754 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1447/2898] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jun 21 10:54:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 21 10:54:56.494605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:54:56.506029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d54d-aa7d-4998-aa37-46a5caa31c61 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:54:56.512200 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:54:56.513225 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:54:56.513507 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:54:56.513783 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] PATH_INFO: `/v3/projects/c4f4b2d36876492ba14f5b521001c5e0/users/2a1a73abfe544e519cda25757dd212a1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:54:56.515949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f4b2d36876492ba14f5b521001c5e0, user_id=2a1a73abfe544e519cda25757dd212a1, role_id=f65af4fdd36b49d9a28f5e1daeaf26f7)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:54:56.518675 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:54:56.530149 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1452/2899] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jun 21 10:54:56 2022] PUT /identity/v3/projects/c4f4b2d36876492ba14f5b521001c5e0/users/2a1a73abfe544e519cda25757dd212a1/roles/f65af4fdd36b49d9a28f5e1daeaf26f7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:55:01.186490 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3743b2-45c4-432c-9b8f-f96d1751cfdc None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:01.186967 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3743b2-45c4-432c-9b8f-f96d1751cfdc None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:01.187257 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3743b2-45c4-432c-9b8f-f96d1751cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:01.222438 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-0d3743b2-45c4-432c-9b8f-f96d1751cfdc None None] MFA Rules not processed for user `2a1a73abfe544e519cda25757dd212a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:55:01.224016 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0d3743b2-45c4-432c-9b8f-f96d1751cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:01.351849 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1448/2900] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:55:01.364927 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:01.367063 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:01.441850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97322a4a-6b2a-4784-9f14-4c951162c9c3 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:01.446665 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee05ef1224e94100b841074a1ea6727c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:01.447330 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:01.447616 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:01.447895 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:01.469213 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:01.510531 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:01.512029 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:01.521519 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1453/2901] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:01.643635 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662dafa-313f-4127-8023-a2bc9ffab4a9 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:01.643928 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662dafa-313f-4127-8023-a2bc9ffab4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:01.644198 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662dafa-313f-4127-8023-a2bc9ffab4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:01.663319 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-d662dafa-313f-4127-8023-a2bc9ffab4a9 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:55:01.664528 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-d662dafa-313f-4127-8023-a2bc9ffab4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:01.730444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1449/2902] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:55:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:55:01.787037 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:01.788646 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:01.866078 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b76506-d236-4f7e-8f98-0e7422868668 service glance] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:01.872413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:01.873095 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:01.873376 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:01.873712 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:01.884377 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:01.886003 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:01.894517 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1454/2903] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:55:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:55:11.326447 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:11.327053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:11.327053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:11.346457 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] MFA Rules not processed for user `26196017350a47ac8633f6741a277006`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:55:11.347684 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:11.356783 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1450/2904] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jun 21 10:55:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:55:11.640576 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:11.642100 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:11.708344 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86360a92-3c2e-4c92-abcf-3b7899d1dee3 service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:11.712278 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:11.712945 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:11.713224 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:11.713501 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:11.715395 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:11.725922 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:11.727426 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62840e5a-2039-4b30-92ba-e0e09fa01037 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:11.736049 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1455/2905] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:12.090082 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:12.091979 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:12.128302 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=100 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:12.174176 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f410d-a7c4-4966-98bc-281a73b48fa2 None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:12.179772 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:12.180432 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:12.180710 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:12.180957 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:12.182925 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:12.195614 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:12.197223 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:12.208636 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1451/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:13.531352 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] REQUEST_METHOD: `POST` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:13.531899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:13.531899 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:13.550790 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.auth.core [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80174) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:55:13.551594 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:13.559991 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1456/2907] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jun 21 10:55:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:55:13.574032 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:13.591053 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844049ef-81aa-4398-af93-4d674ca8bf6b service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:13.596682 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:13.597095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:13.597373 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:13.597650 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:13.606833 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:13.608425 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:13.618240 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1452/2908] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:55:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:55:23.544916 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=79 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:23.613507 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=26 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:30.890592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:30.892192 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:30.983949 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78ee98-62fd-4fb4-b00e-786d509897b7 None None] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:30.989447 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:30.990136 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:30.990422 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:30.990698 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:30.992648 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:31.005870 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:31.007592 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:31.019148 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1457/2909] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:33.339484 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:33.353830 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46debeb6-b35a-46c0-b878-f1971cdc5e16 service swift] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:33.358027 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:33.358703 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:33.358985 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:33.359258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:33.361479 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:33.376955 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:33.378444 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:33.390209 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1453/2910] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:41.014304 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=34 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:43.384747 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:43.547868 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:43.557850 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd0746-2fbe-43dc-a6ec-ad1db1decfd0 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:43.561979 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:43.562645 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:43.562929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:43.563206 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:43.565139 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:55:43.579408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:43.581034 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:43.593097 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1458/2911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:43.722913 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:55:43.732659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695c78c-f9f0-4014-9be4-5f24e3f4d49f service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:55:43.737113 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:55:43.737787 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:55:43.738080 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:55:43.738376 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:55:43.748391 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:55:43.749843 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:55:43.759596 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1454/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:55:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:55:53.587285 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:55:53.755388 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=6 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:56:48.080929 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:56:48.090087 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af66af55-101f-4a7f-842f-460fe63dabad service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:56:48.094739 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c697d2c7a55047eaaad9dadab5b8e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:56:48.095403 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:56:48.095688 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:56:48.095966 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:56:48.097920 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:56:48.111785 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:56:48.113254 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:56:48.121612 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1459/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:56:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:56:58.118339 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=6 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:03.969221 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:04.042963 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc9cbf-f3ef-4138-9760-42e61a151793 service neutron] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:04.049630 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:04.051063 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:04.051524 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:04.052087 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:04.054205 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:04.094216 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:04.096201 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec4571c-f803-440c-8f46-09a49f9e98d1 service nova] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:04.109601 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1455/2914] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:58:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:58:10.104719 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:10.132692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce37ff-d5c8-45a7-a2ea-18bd41166ac3 service neutron] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:10.140291 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a43c2cee600846c99e25b81e21726370', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:10.141860 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:10.142483 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:10.142778 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:10.146077 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:10.161368 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:10.163053 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:10.174672 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1460/2915] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 21 10:58:11.272914 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] REQUEST_METHOD: `POST` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:11.273416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:11.273416 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:11.292791 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.auth.core [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] MFA Rules not processed for user `ab0772e95f25425286c921316cc19411`. Rule list: `[]` (Enabled: `True`). {{(pid=80175) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 21 10:58:11.294013 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:11.302137 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1456/2916] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jun 21 10:58:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 21 10:58:11.347944 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:11.360933 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a51eb-5040-4d8a-b275-3268d83a2073 service nova] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:11.367267 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '965fa890ec864b0c870bba47db2f7ffb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:11.367911 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:11.368202 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:11.368478 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:11.377051 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:11.378732 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:11.387605 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1461/2917] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jun 21 10:58:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 21 10:58:14.858674 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:14.876289 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf398617-11d7-480c-9314-d7c433f07bcf None None] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:14.882272 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:14.883001 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] REQUEST_METHOD: `GET` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:14.883362 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:14.883695 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:14.885655 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:14.905185 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:14.907071 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:14.922676 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1457/2918] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:58:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 10:58:18.144161 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:18.215026 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54644015-9cd0-484d-bacc-469c032b700a service swift] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:18.220076 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:18.220957 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:18.221237 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:18.221514 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] PATH_INFO: `/v3/users/26196017350a47ac8633f6741a277006` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:18.222718 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26196017350a47ac8633f6741a277006)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:18.224692 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:18.274533 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26196017350a47ac8633f6741a277006'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.281110 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26196017350a47ac8633f6741a277006'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.281801 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26196017350a47ac8633f6741a277006'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.289794 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26196017350a47ac8633f6741a277006'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.290479 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26196017350a47ac8633f6741a277006'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.307716 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1462/2919] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:58:18 2022] DELETE /identity/v3/users/26196017350a47ac8633f6741a277006 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:58:18.496043 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:18.507503 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430292-9863-4d5f-8ba1-88a6b1f6184e service placement] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:18.565258 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:18.566187 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:18.566463 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:18.566709 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] PATH_INFO: `/v3/projects/b0144da9d9c2404ba08c90e551b1e5c8` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:18.568424 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0144da9d9c2404ba08c90e551b1e5c8)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:18.570364 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:18.620471 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0144da9d9c2404ba08c90e551b1e5c8', 'request_id': 'req-0cfee274-e1a4-4301-b31d-6b376f8ee409'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.628256 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0144da9d9c2404ba08c90e551b1e5c8', 'request_id': 'req-0cfee274-e1a4-4301-b31d-6b376f8ee409'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.634809 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0144da9d9c2404ba08c90e551b1e5c8', 'request_id': 'req-0cfee274-e1a4-4301-b31d-6b376f8ee409'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.645644 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] The token cache is being invalidate because project b0144da9d9c2404ba08c90e551b1e5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:58:18.645933 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.646677 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.648341 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1458/2920] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:58:18 2022] DELETE /identity/v3/projects/b0144da9d9c2404ba08c90e551b1e5c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:58:18.652466 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:18.654119 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:18.668894 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575741b5-12e2-401d-9901-5bc480f81952 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:18.712590 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:18.730413 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:18.731303 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:18.731586 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:18.731863 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] PATH_INFO: `/v3/users/2a1a73abfe544e519cda25757dd212a1` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:18.733064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a1a73abfe544e519cda25757dd212a1)` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:18.735065 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:18.784547 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a1a73abfe544e519cda25757dd212a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.795384 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a1a73abfe544e519cda25757dd212a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.796453 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a1a73abfe544e519cda25757dd212a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.807358 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a1a73abfe544e519cda25757dd212a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.808014 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.notifications [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a1a73abfe544e519cda25757dd212a1'} {{(pid=80174) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:18.827064 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1463/2921] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jun 21 10:58:18 2022] DELETE /identity/v3/users/2a1a73abfe544e519cda25757dd212a1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:58:19.019874 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Authenticating user token {{(pid=80175) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:58:19.021502 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.fernet_utils [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80175) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:58:19.035434 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee274-e1a4-4301-b31d-6b376f8ee409 admin admin] Validating token access rules against request {{(pid=80175) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:58:19.041512 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:19.098193 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b6ff555140924a9182c287c0588e7e67', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebccc8110983425eae462769b51519c6', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80175) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:58:19.099064 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:58:19.099349 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:58:19.099654 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] PATH_INFO: `/v3/projects/c4f4b2d36876492ba14f5b521001c5e0` {{(pid=80175) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:58:19.101019 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f4b2d36876492ba14f5b521001c5e0)` {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:58:19.103020 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] RBAC: Authorization granted {{(pid=80175) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:58:19.153659 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f4b2d36876492ba14f5b521001c5e0', 'request_id': 'req-c4b09e6b-7801-4cbe-a827-d5db204ac299'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:19.162350 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f4b2d36876492ba14f5b521001c5e0', 'request_id': 'req-c4b09e6b-7801-4cbe-a827-d5db204ac299'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:19.169117 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f4b2d36876492ba14f5b521001c5e0', 'request_id': 'req-c4b09e6b-7801-4cbe-a827-d5db204ac299'} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:19.179536 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] The token cache is being invalidate because project c4f4b2d36876492ba14f5b521001c5e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80175) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 21 10:58:19.179817 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:19.180506 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG keystone.notifications [None req-c4b09e6b-7801-4cbe-a827-d5db204ac299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80175) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 21 10:58:19.182095 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: [pid: 80175|app: 0|req: 1459/2922] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jun 21 10:58:19 2022] DELETE /identity/v3/projects/c4f4b2d36876492ba14f5b521001c5e0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 21 10:58:28.824830 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:58:29.176736 dv-cinder-836973-8-iscsi devstack@keystone.service[80175]: DEBUG dbcounter [-] [80175] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80175) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 21 10:59:58.075120 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Authenticating user token {{(pid=80174) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 21 10:59:58.077239 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:59:58.173724 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab0f30c-6cc1-42d9-8a3a-d6f0fd1e6f61 admin admin] Validating token access rules against request {{(pid=80174) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 21 10:59:58.236112 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b0728c2b6a3473fb4e08f81144c7b14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a922fd1809c4a278bff6b545c0397c2', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80174) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 21 10:59:58.236772 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] REQUEST_METHOD: `GET` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 21 10:59:58.237054 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] SCRIPT_NAME: `/identity` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 21 10:59:58.237317 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80174) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 21 10:59:58.239324 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.fernet_utils [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80174) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 21 10:59:58.251230 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 21 10:59:58.252971 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876ef7e-620f-4359-9b1e-2662abc62ae0 service placement] RBAC: Authorization granted {{(pid=80174) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 21 10:59:58.264408 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: [pid: 80174|app: 0|req: 1464/2923] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jun 21 10:59:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 21 11:00:08.259437 dv-cinder-836973-8-iscsi devstack@keystone.service[80174]: DEBUG dbcounter [-] [80174] Writing DB stats keystone:SELECT=67 {{(pid=80174) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}